-- Logs begin at Thu 2022-01-27 16:05:34 UTC, end at Thu 2022-01-27 17:06:50 UTC. -- Jan 27 16:35:30.658257 dv-cinder-818830-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jan 27 16:35:30.666931 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jan 27 16:35:30 2022] *** Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: nodename: dv-cinder-818830-2-iscsi Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: machine: x86_64 Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: clock source: unix Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: pcre jit disabled Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: detected number of CPU cores: 4 Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: current working directory: / Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: detected binary path: /usr/bin/uwsgi-core Jan 27 16:35:30.668934 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: your processes number limit is 47680 Jan 27 16:35:30.669553 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: your memory page size is 4096 bytes Jan 27 16:35:30.669553 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: detected max file descriptor number: 2048 Jan 27 16:35:30.669553 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: lock engine: pthread robust mutexes Jan 27 16:35:30.669553 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: thunder lock: enabled Jan 27 16:35:30.669553 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jan 27 16:35:30.669553 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 27 16:35:30.714800 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: Python main interpreter initialized at 0x564e505b89c0 Jan 27 16:35:30.714800 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: python threads support enabled Jan 27 16:35:30.714800 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: your server socket listen backlog is limited to 100 connections Jan 27 16:35:30.714800 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: your mercy for graceful operations on workers is 90 seconds Jan 27 16:35:30.715141 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: mapped 403077 bytes (393 KB) for 2 cores Jan 27 16:35:30.715210 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: *** Operational MODE: preforking *** Jan 27 16:35:30.715479 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: *** uWSGI is running in multiple interpreter mode *** Jan 27 16:35:30.715479 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: spawned uWSGI master process (pid: 90772) Jan 27 16:35:30.715703 dv-cinder-818830-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jan 27 16:35:30.717260 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: spawned uWSGI worker 1 (pid: 90784, cores: 1) Jan 27 16:35:30.717260 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: spawned uWSGI worker 2 (pid: 90785, cores: 1) Jan 27 16:35:30.717260 dv-cinder-818830-2-iscsi devstack@keystone.service[90772]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 27 16:35:36.522126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:35:36.522126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: from cryptography.utils import int_from_bytes Jan 27 16:35:36.522917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:35:36.522917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: from cryptography.utils import int_from_bytes Jan 27 16:35:36.523170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:35:36.523170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: from cryptography.utils import int_from_bytes Jan 27 16:35:36.523643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 27 16:35:36.523643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: from cryptography.utils import int_from_bytes Jan 27 16:35:36.569378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 16:35:36.569520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 27 16:35:36.569605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 16:35:36.569694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 27 16:35:36.569775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] command line args: [] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 16:35:36.569891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] command line args: [] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 27 16:35:36.570010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 16:35:36.570160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 27 16:35:36.570245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ================================================================================ {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 16:35:36.570325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ================================================================================ {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 27 16:35:36.570437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] admin_token = **** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.570575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] admin_token = **** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.570690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] config_dir = [] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.570821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] config_dir = [] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.570905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.571007 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.571095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] config_source = [] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.571172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] config_source = [] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.571247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] debug = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.571350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] debug = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.571434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.571686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.572783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.572903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.572903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] insecure_debug = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] list_limit = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] list_limit = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] log_config_append = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] log_config_append = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] log_dir = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.573946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] log_dir = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] log_file = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] log_file = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.574924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575849 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.575972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.576060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.576135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.576254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.576368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.576486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] notification_format = cadf {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.576643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.576768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.577126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.577259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.577344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] publish_errors = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.577447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] publish_errors = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.577534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.577682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.577801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.577900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.577982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.578103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.578227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.578313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.578392 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.578540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.578626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] standard_threads = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.578780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] standard_threads = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.578857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579015 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] strict_password_check = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] use_journal = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] use_eventlog = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] use_json = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] use_journal = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] use_stderr = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] use_json = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.579976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] use_syslog = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.580090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] use_stderr = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.580169 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.580239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] use_syslog = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.580306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.580424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] watch_log_file = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 27 16:35:36.580537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.580622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.580796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.580873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.581033 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.581117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.581267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.581345 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.581501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.581579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.581747 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.581831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.581983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.582067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.582224 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.582300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.582467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.582549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.582715 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.582793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.582950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.583036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.583190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.583266 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.583422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.583505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.583685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.583812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.583980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.584106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.584214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.584490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.584699 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.584792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.584864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.584942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.585105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.585190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.585373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.585451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.585629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.585717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.585873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.585950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.586132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.586215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.586364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.586450 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.586595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.586679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.586823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.586900 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.587057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.587212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.587290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.587361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.587538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.587645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.587794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.587883 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.588024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.588108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.588270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.588347 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.588503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.588590 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.588738 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.588814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.588983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.589059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.589213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.589299 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.589446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.589523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.589679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.589768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.589906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.589992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.590134 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.590211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.590362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.590439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.590591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.590676 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.590823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.590930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.591059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.591166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.591284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.591385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.591504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.591638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.591758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.591880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.591993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.592072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.592220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.592303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.592447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.592526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.592673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.592757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.592907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.592985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.593140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.593227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.593373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.593453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.593606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.593694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.593840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.593921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.594071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.594158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.594302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.594387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.594539 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.594626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.594771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.594858 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.594997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.595115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.595245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.595364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.595478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.595562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.595725 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.595799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.595951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.596041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.596184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.596303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.596427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.596505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.596665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.596750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.596902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.596987 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.597133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.597213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.597379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.597456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.597613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.597690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.597846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.597929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.598078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.598156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.enabled = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.598309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.598387 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.598532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.598612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.598762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.598841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.598997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.599125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.599217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.599291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.600026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.600174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.600309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.600453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.600564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.600637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.600751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.600883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.600981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.601104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.601197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.601332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.601432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.601571 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.601669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.601795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.601904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.602042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.602143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.602277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.602382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.602535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.602635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.602795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.602875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.603035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.603114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.603265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] auth.external = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.603370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.603495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.603635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.603822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.603901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] auth.external = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.604055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.604132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] auth.mapped = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.604290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] auth.password = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.604376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.604520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] auth.token = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.604598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.604756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.604834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] auth.password = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.604991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.605070 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] auth.token = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.605236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.605314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.605466 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.605543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] catalog.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.605712 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.605793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.605945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.606028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.606171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.606255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.606404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] credential.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.606509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.606649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.606727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.606886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] credential.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.606971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.607129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.607210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] credential.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.607364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.607444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.607626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.607708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.607862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.607969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.608105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.608183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.608529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.608602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.608684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.608769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.608842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.608911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.609051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.609130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.609309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.609396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.609567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.609646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.609809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.609888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.610062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.610149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.610297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] federation.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.610376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.610546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.610626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.610789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] federation.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.610878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.611032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.611110 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.611259 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.611339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] federation.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.611503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.611610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.611760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.611841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.612012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.612092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.612246 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.612333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.612498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.612578 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.612736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.612814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.612978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.613129 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.613205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.613276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.613446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.613525 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.613682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.613769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.613912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.613990 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.614149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.614229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.614394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.614481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.614624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.614704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.614856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.614936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.615153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.615849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.615985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.616120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.616288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.616405 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.616521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.616669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.616751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.616908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.616988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.617144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.617224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.617380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.617467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.617629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.617709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.617881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.617960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.618134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.618214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.618393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.618472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.618628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.618714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.618859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.618939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.619093 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.619172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.619323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.619411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.619557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.619657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.619822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.619899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.620054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.620146 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.620291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.620371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.620518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.620596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.620764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.620850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.621010 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.621095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.621242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.621320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.621485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.621571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.621730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.621810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.621958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.622037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.622191 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.622278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.622417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.622496 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.622650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.622730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.622883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.622970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.623113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.password = **** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.623234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.623342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.623426 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.623585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.623688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.623839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.623928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.624079 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.624163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.624310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.624399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.624539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.624621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.624785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.624867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.625017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.625111 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.625251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.625334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.625481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.625561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.625713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.625806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.625941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.626023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.626179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.626261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.626413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.626502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.626644 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.626726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.626885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.626966 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.627130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.627220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.627368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.627459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.627620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.627716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.627853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.627945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.628089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.628171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.628324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.628407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.628557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.628646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.628784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.628864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.629018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.629097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.629255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.629344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.629488 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.629570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.629730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.629810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.629975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.630064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.630201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.630282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.630445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.630528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.630703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.630827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.630953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.631079 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.631160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.631312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.631412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.631619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.631713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.631867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.631960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.632100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.632202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.632339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.632428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.632572 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.632662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.632814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.632914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.633047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.633138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.633279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.633371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] policy.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.633515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.633615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.633759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.633858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.633998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.634088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.634231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.634330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] receipt.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.634464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.634554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.634701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] resource.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.634791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.634945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.635050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.635182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.635289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.635413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.635494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.635676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] resource.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.635772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.635923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.636003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.636157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.636237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] resource.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.636400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.636551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.636627 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.636697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.636856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.636936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.637091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] role.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.637178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] revoke.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.637337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] role.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.637417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.637572 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.637651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.637810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] role.cache_time = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.637897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.638048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] role.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.638128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.638294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.638372 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] role.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.638527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] role.list_limit = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.638613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.638777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.638856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.639023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.639102 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.639268 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.639356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.639514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.639612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.639770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.639850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.640017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.640109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.640264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.640344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.640509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.640595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.640742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.640828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.640991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.641130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.641246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.641363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.641495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.641611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.641744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.641859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.642104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.642182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.642351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.642432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.642581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.642661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.642831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.642910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.643078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.643158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.643311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.643389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.643539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.643680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.643791 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.643874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.644022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.644102 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.644276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.644356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.644507 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.644586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.644739 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.644818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.644973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.645052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.645210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.645289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.645439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.645518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.645673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] token.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.645752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.645906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.645987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.646152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.646238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.646429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] token.cache_time = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.646567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.646715 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.646850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] token.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.646934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.646995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.647137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.647218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] token.provider = fernet {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.647379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.647461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.647651 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.647735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.647903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.647981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.648136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.648216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.648372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.648452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.648606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.648685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.648852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.648933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] trust.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.649088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.649165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.649319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.649397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.649554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.649633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.649805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.650144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.650323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.650403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.connection = **** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.650557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.650638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.650803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.650880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.651040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.651127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.651281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.651360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.connection = **** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.651517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.651621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.651776 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.651867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.652014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.652122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.652247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.652331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.652497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.652595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.652736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.652821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.652973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.653086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.653210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.653329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.653493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.653584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.653732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.653823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.654042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.654124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.654273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.654354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.654514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.654599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.654750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.654833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.654906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90785) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 16:35:36.655028 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.655266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.655512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.655780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 27 16:35:36.655954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=90784) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 27 16:35:36.684523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.684752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.684975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.685443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.685678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.685907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.694031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.694940 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.723898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.724128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.725228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.725461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.777768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.778070 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.828925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.829158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.829893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.830133 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.894280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.894504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.894703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.894793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.894939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.895046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.895153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.895238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.895368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.895455 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.895610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.895833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.919968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.920181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.920271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.920412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.920498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.920633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.920719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.920848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.920934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.921060 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.921147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.921271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.921357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.921485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.933128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.933594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.945806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.946071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.946264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.946394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.946484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.946632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.946717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.946860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.946955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.947076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90785) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.947160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.947294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.947510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.947755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=90784) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jan 27 16:35:36.964661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.964875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 27 16:35:36.965212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.965298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.965414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 27 16:35:36.965513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 27 16:35:36.965680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.965765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.965935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jan 27 16:35:36.966018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.966187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.966280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.966442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.966524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.966699 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.966959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.977197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.977472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.977721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.977805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.977996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.978080 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.978263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.978546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.985840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:36.986445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:36.989009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:36.991617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.991914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.991998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:36.992204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.992304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.992492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.992577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.992760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.992845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.993034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.993119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.993312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.993398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.993581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.993666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.993851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.993942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.994115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.994198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.994385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:36.994653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.019744 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.020279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.021297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.022108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.022379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.022663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.027438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.027738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.028058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.028193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.028326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.028599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.035018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.035297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.035785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.036070 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.039883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.040166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.040448 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.040577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.040736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.040877 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.041021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.041154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.041284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.041414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.041545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.041684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.041814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.041945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.042122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.042399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.060716 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.060991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.061120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.061346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.065433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.065802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.069188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.069473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.069603 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.069772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.074330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.074690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.077953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.078307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.081489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.081787 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.081929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.082058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.082185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.082341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.082481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.082618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.082745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.082901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.083030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.083234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.102227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.102481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.102750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.103014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.103371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.103691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.103966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.104232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.110602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.111867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.112288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.112562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.113550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.113831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.116048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.116331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.116608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.116886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.117167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.117721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.118006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.118307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.118592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.118996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.130039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.130316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.130593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.130925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.131203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.131483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.131804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.132421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.132708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.132990 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.133272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.133552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.133837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.134120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.149153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.151909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.152576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.155059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.155799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.157351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.158395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.158934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.159214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.159496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.160003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.161751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.162745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.163013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.167403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.168985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.170111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.171698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.172104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.172402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.172685 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.172967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.174810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.175114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.175402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.175731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.182447 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.182734 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.183024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.185489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.185781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.186066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.190591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90785) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.190873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.191181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.191443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.191808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.192078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.192363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.192637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.192912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.193188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.193489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.193748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.194105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=90784) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jan 27 16:35:37.194198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.194372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90785) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.194472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.194668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.194948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.195223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.195498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.195823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.196097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.196421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.196759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.197142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.197413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.197685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.197971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=90784) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jan 27 16:35:37.231679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564e505b89c0 pid: 90785 (default app) Jan 27 16:35:37.235915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7e1b4-34cb-465c-969b-00ca5c785260 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:37.236212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7e1b4-34cb-465c-969b-00ca5c785260 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:37.236493 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7e1b4-34cb-465c-969b-00ca5c785260 None None] PATH_INFO: `/v3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:37.237403 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564e505b89c0 pid: 90784 (default app) Jan 27 16:35:37.241109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu Jan 27 16:35:37 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:45.431726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56205214-e50a-4b2f-a545-714c02bf02c3 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:45.432248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56205214-e50a-4b2f-a545-714c02bf02c3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:45.432330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56205214-e50a-4b2f-a545-714c02bf02c3 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:45.437350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:35:45.442539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:45.442933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:45.443088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:45.569916 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG oslo_db.sqlalchemy.engines [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90785) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:35:45.755947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG passlib.handlers.bcrypt [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90785) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 27 16:35:45.756280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG passlib.handlers.bcrypt [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90785) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 27 16:35:45.811781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:45.813372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:45.946904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:35:46.071884 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56205214-e50a-4b2f-a545-714c02bf02c3 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:46.105545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG oslo_db.sqlalchemy.engines [None req-56205214-e50a-4b2f-a545-714c02bf02c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=90784) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 27 16:35:46.330769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56205214-e50a-4b2f-a545-714c02bf02c3 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:46.334890 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e611519-3058-40ad-8022-692fcf1b433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:46.336114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e611519-3058-40ad-8022-692fcf1b433d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:46.336400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e611519-3058-40ad-8022-692fcf1b433d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:46.336684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e611519-3058-40ad-8022-692fcf1b433d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:46.344687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e611519-3058-40ad-8022-692fcf1b433d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:46.395312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7e611519-3058-40ad-8022-692fcf1b433d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 27 16:35:46.395675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e611519-3058-40ad-8022-692fcf1b433d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:46.405594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:35:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:35:46.411506 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:46.425760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dcacc-6a06-426f-a91c-ca341358bd45 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:46.430417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f138e9-9e11-4047-a9b2-091b41e1c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:46.431586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f138e9-9e11-4047-a9b2-091b41e1c2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:46.431885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f138e9-9e11-4047-a9b2-091b41e1c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:46.432159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f138e9-9e11-4047-a9b2-091b41e1c2b4 admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:46.433647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f138e9-9e11-4047-a9b2-091b41e1c2b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e1134f718c7471d948ccfe1ca59674e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:46.484587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a6f138e9-9e11-4047-a9b2-091b41e1c2b4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jan 27 16:35:46.485125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f138e9-9e11-4047-a9b2-091b41e1c2b4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:46.489518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:35:46 2022] GET /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:48.669353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff639dc-3d48-4149-af2e-6ccb3c97dea5 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:48.669860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff639dc-3d48-4149-af2e-6ccb3c97dea5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:48.669971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff639dc-3d48-4149-af2e-6ccb3c97dea5 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:48.674482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:35:48.680460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80fac2-552a-4c3e-9749-2ca891dee7e6 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:48.680870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80fac2-552a-4c3e-9749-2ca891dee7e6 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:48.681023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80fac2-552a-4c3e-9749-2ca891dee7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:48.699976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6b80fac2-552a-4c3e-9749-2ca891dee7e6 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:48.701477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6b80fac2-552a-4c3e-9749-2ca891dee7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:48.709164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:35:48.732332 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff639dc-3d48-4149-af2e-6ccb3c97dea5 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:48.745062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff639dc-3d48-4149-af2e-6ccb3c97dea5 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:48.749253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfba035-47cf-44b9-878b-3119cd9ae9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:48.749888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfba035-47cf-44b9-878b-3119cd9ae9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:48.750181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfba035-47cf-44b9-878b-3119cd9ae9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:48.750465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfba035-47cf-44b9-878b-3119cd9ae9e1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:48.758751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfba035-47cf-44b9-878b-3119cd9ae9e1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:48.760590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfba035-47cf-44b9-878b-3119cd9ae9e1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:48.769165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:35:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:35:48.774703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80fac2-552a-4c3e-9749-2ca891dee7e6 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:48.783649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80fac2-552a-4c3e-9749-2ca891dee7e6 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:48.787922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411b128-d7d3-4263-b1bb-4845db233713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:48.789136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411b128-d7d3-4263-b1bb-4845db233713 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:48.789741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411b128-d7d3-4263-b1bb-4845db233713 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:48.789933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411b128-d7d3-4263-b1bb-4845db233713 admin admin] PATH_INFO: `/v3/users/8b36880779e54979b4c28d8db11f3446` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:48.791335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411b128-d7d3-4263-b1bb-4845db233713 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b36880779e54979b4c28d8db11f3446)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:48.793192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411b128-d7d3-4263-b1bb-4845db233713 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:48.794727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:35:48 2022] GET /identity/v3/users/8b36880779e54979b4c28d8db11f3446 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:51.092283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ed27-0bee-4429-9691-fe30e41c820c None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.092798 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ed27-0bee-4429-9691-fe30e41c820c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.092880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645ed27-0bee-4429-9691-fe30e41c820c None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.094576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:35:51.099814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d015613-8a8d-4f3b-be8e-09bec3993567 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.100210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d015613-8a8d-4f3b-be8e-09bec3993567 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.100370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d015613-8a8d-4f3b-be8e-09bec3993567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.111706 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e85ef-7efd-4c22-9d27-af4258be572b None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.111998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e85ef-7efd-4c22-9d27-af4258be572b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.112280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e85ef-7efd-4c22-9d27-af4258be572b None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.113996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:35:51.119527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2d015613-8a8d-4f3b-be8e-09bec3993567 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:51.119663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39375fb-856a-4162-934f-76e63c5887c9 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.119904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39375fb-856a-4162-934f-76e63c5887c9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.120187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39375fb-856a-4162-934f-76e63c5887c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.120738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2d015613-8a8d-4f3b-be8e-09bec3993567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:51.128295 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:35:51.152540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d015613-8a8d-4f3b-be8e-09bec3993567 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:51.161070 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG passlib.handlers.bcrypt [None req-f39375fb-856a-4162-934f-76e63c5887c9 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=90784) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jan 27 16:35:51.161504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG passlib.handlers.bcrypt [None req-f39375fb-856a-4162-934f-76e63c5887c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=90784) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jan 27 16:35:51.161626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d015613-8a8d-4f3b-be8e-09bec3993567 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:51.166278 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83180d5-9294-4a2b-8e93-851a805ca270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:51.167064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83180d5-9294-4a2b-8e93-851a805ca270 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.167353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83180d5-9294-4a2b-8e93-851a805ca270 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.167663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83180d5-9294-4a2b-8e93-851a805ca270 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.181076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83180d5-9294-4a2b-8e93-851a805ca270 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:35:51.187924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-a83180d5-9294-4a2b-8e93-851a805ca270 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:35:51.189098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 7/13] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:35:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:35:51.194557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83180d5-9294-4a2b-8e93-851a805ca270 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:51.204276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83180d5-9294-4a2b-8e93-851a805ca270 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:51.208566 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:51.208903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-f39375fb-856a-4162-934f-76e63c5887c9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:51.209167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.209457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.209739 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.210487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:35:51.210569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f39375fb-856a-4162-934f-76e63c5887c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:51.210828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:51.212794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:35:51.212794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:35:51.212794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:35:51.213798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:51.226791 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 8/14] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:35:51.232075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:51.232583 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 7/15] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:35:51.241337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded93b1e-1a65-419f-a86a-64559ac49fc6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:51.246696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79574f4c-568b-456f-a3a5-387c06c39232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:51.247544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574f4c-568b-456f-a3a5-387c06c39232 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.247867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574f4c-568b-456f-a3a5-387c06c39232 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.248150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79574f4c-568b-456f-a3a5-387c06c39232 admin admin] PATH_INFO: `/v3/users/8b36880779e54979b4c28d8db11f3446` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.249360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79574f4c-568b-456f-a3a5-387c06c39232 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b36880779e54979b4c28d8db11f3446)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:51.251180 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79574f4c-568b-456f-a3a5-387c06c39232 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:51.252752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 9/16] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:35:51 2022] GET /identity/v3/users/8b36880779e54979b4c28d8db11f3446 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:35:51.255122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39375fb-856a-4162-934f-76e63c5887c9 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:51.257579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79574f4c-568b-456f-a3a5-387c06c39232 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:51.266480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39375fb-856a-4162-934f-76e63c5887c9 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:51.267442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79574f4c-568b-456f-a3a5-387c06c39232 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:51.270850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f42b4-0481-4e31-b0bc-9fecfdee1c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:51.271754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483c358-d8c0-4a89-b040-619d20c34c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:51.271866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f42b4-0481-4e31-b0bc-9fecfdee1c7a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.272126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f42b4-0481-4e31-b0bc-9fecfdee1c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.272400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f42b4-0481-4e31-b0bc-9fecfdee1c7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.272507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483c358-d8c0-4a89-b040-619d20c34c46 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.272796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483c358-d8c0-4a89-b040-619d20c34c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.273080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483c358-d8c0-4a89-b040-619d20c34c46 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.274511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483c358-d8c0-4a89-b040-619d20c34c46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:51.276244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483c358-d8c0-4a89-b040-619d20c34c46 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:51.278043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 10/17] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:35:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:35:51.280736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f42b4-0481-4e31-b0bc-9fecfdee1c7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:51.282536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f42b4-0481-4e31-b0bc-9fecfdee1c7a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:51.283460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483c358-d8c0-4a89-b040-619d20c34c46 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:51.291475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 8/18] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:35:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:35:51.293424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483c358-d8c0-4a89-b040-619d20c34c46 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:51.296712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f42b4-0481-4e31-b0bc-9fecfdee1c7a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:51.297713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7677f-1353-408a-8b77-5da5f5ffcf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:51.298327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7677f-1353-408a-8b77-5da5f5ffcf9d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.298638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7677f-1353-408a-8b77-5da5f5ffcf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.298917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7677f-1353-408a-8b77-5da5f5ffcf9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.299769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7677f-1353-408a-8b77-5da5f5ffcf9d admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.domain.id=default, user.id=8b36880779e54979b4c28d8db11f3446) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:35:51.300079 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7677f-1353-408a-8b77-5da5f5ffcf9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:51.301071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-0bb7677f-1353-408a-8b77-5da5f5ffcf9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:35:51.301071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:35:51.301071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:35:51.302223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7677f-1353-408a-8b77-5da5f5ffcf9d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:51.305869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f42b4-0481-4e31-b0bc-9fecfdee1c7a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:51.309728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 11/19] 10.222.0.48 () {56 vars in 1343 bytes} [Thu Jan 27 16:35:51 2022] GET /identity/v3/role_assignments?user.id=8b36880779e54979b4c28d8db11f3446&scope.domain.id=default&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 233 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:35:51.310254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ca7b-724c-4cbb-b026-a8d911044572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:51.311024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ca7b-724c-4cbb-b026-a8d911044572 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:51.311315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ca7b-724c-4cbb-b026-a8d911044572 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:51.311618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ca7b-724c-4cbb-b026-a8d911044572 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:51.313037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ca7b-724c-4cbb-b026-a8d911044572 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:51.314783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ca7b-724c-4cbb-b026-a8d911044572 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:51.316485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 9/20] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:35:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:35:54.079983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78d92-b163-4983-bd3c-87328e30060d None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.080493 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78d92-b163-4983-bd3c-87328e30060d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.080567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78d92-b163-4983-bd3c-87328e30060d None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.082565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 12/21] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:35:54.088697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db058057-93d1-4c23-8294-03a9ded36c7f None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.089658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db058057-93d1-4c23-8294-03a9ded36c7f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.090137 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db058057-93d1-4c23-8294-03a9ded36c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.121556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-db058057-93d1-4c23-8294-03a9ded36c7f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:54.123097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-db058057-93d1-4c23-8294-03a9ded36c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:54.135797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 10/22] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:35:54.185044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78d92-b163-4983-bd3c-87328e30060d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.201048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78d92-b163-4983-bd3c-87328e30060d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:54.205827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af17150-1ad1-4e88-99d3-3de64d2ad614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:54.206880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af17150-1ad1-4e88-99d3-3de64d2ad614 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.207365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af17150-1ad1-4e88-99d3-3de64d2ad614 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.207867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af17150-1ad1-4e88-99d3-3de64d2ad614 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.221209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af17150-1ad1-4e88-99d3-3de64d2ad614 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:54.223418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af17150-1ad1-4e88-99d3-3de64d2ad614 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:54.248514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-0af17150-1ad1-4e88-99d3-3de64d2ad614 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:35:54.249851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 13/23] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:35:54.256021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db058057-93d1-4c23-8294-03a9ded36c7f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.270258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db058057-93d1-4c23-8294-03a9ded36c7f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:54.281403 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ef4c7b-7ab1-4145-b27a-d65bf1ccf327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:54.282501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef4c7b-7ab1-4145-b27a-d65bf1ccf327 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.282987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef4c7b-7ab1-4145-b27a-d65bf1ccf327 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.283461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef4c7b-7ab1-4145-b27a-d65bf1ccf327 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.284520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef4c7b-7ab1-4145-b27a-d65bf1ccf327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:35:54.285041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef4c7b-7ab1-4145-b27a-d65bf1ccf327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:54.287073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-97ef4c7b-7ab1-4145-b27a-d65bf1ccf327 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:35:54.287073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:35:54.287073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:35:54.288397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ef4c7b-7ab1-4145-b27a-d65bf1ccf327 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:54.312032 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 11/24] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:54.317228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af17150-1ad1-4e88-99d3-3de64d2ad614 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.333015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af17150-1ad1-4e88-99d3-3de64d2ad614 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:54.348186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a84d-5f3d-49c4-8af2-fdee26a10ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:54.348850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a84d-5f3d-49c4-8af2-fdee26a10ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.349185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a84d-5f3d-49c4-8af2-fdee26a10ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.349465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a84d-5f3d-49c4-8af2-fdee26a10ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.350209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205a84d-5f3d-49c4-8af2-fdee26a10ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:54.351236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-a205a84d-5f3d-49c4-8af2-fdee26a10ba4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:35:54.351236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:35:54.351236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:35:54.352885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205a84d-5f3d-49c4-8af2-fdee26a10ba4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:54.385939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527eaa5-c1ca-485b-9464-e2d6c9f5d950 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.386610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527eaa5-c1ca-485b-9464-e2d6c9f5d950 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.387095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527eaa5-c1ca-485b-9464-e2d6c9f5d950 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.389147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 12/25] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:35:54.394712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a2dea-63a6-4e7f-bffa-678a8203fa2d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.395255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a2dea-63a6-4e7f-bffa-678a8203fa2d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.395809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a2dea-63a6-4e7f-bffa-678a8203fa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.423896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-c70a2dea-63a6-4e7f-bffa-678a8203fa2d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:54.425086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c70a2dea-63a6-4e7f-bffa-678a8203fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:54.443495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:35:54.487402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a2dea-63a6-4e7f-bffa-678a8203fa2d None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.500747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a2dea-63a6-4e7f-bffa-678a8203fa2d None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:54.516972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e33f0-e962-4515-9269-d66b37b4492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:54.518068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e33f0-e962-4515-9269-d66b37b4492a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.518492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e33f0-e962-4515-9269-d66b37b4492a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.518905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e33f0-e962-4515-9269-d66b37b4492a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.521378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 14/27] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:35:54 2022] POST /identity/v3/projects => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:35:54.536484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e33f0-e962-4515-9269-d66b37b4492a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:35:54.544054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-ee6e33f0-e962-4515-9269-d66b37b4492a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:35:54.549991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 14/28] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:35:54.551638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a84d-5f3d-49c4-8af2-fdee26a10ba4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.572654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54e13-91ae-47b3-8585-ec27fc27951d None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.572962 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54e13-91ae-47b3-8585-ec27fc27951d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.573216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e54e13-91ae-47b3-8585-ec27fc27951d None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.575096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 15/29] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:35:54.580841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36acf03-9878-4c7b-9372-8123ede53ac5 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.581131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36acf03-9878-4c7b-9372-8123ede53ac5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.581411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36acf03-9878-4c7b-9372-8123ede53ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.622722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-f36acf03-9878-4c7b-9372-8123ede53ac5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:54.623893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f36acf03-9878-4c7b-9372-8123ede53ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:54.659405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a84d-5f3d-49c4-8af2-fdee26a10ba4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:54.669764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00306f95-9621-4a6a-8fad-027b2e1e1718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:54.675610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00306f95-9621-4a6a-8fad-027b2e1e1718 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.675610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00306f95-9621-4a6a-8fad-027b2e1e1718 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.675610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00306f95-9621-4a6a-8fad-027b2e1e1718 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.675610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00306f95-9621-4a6a-8fad-027b2e1e1718 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:35:54.675610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00306f95-9621-4a6a-8fad-027b2e1e1718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:54.676410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00306f95-9621-4a6a-8fad-027b2e1e1718 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:54.697315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 15/30] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:54.703608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69da32-0761-4237-868c-2ce9d0965c97 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.705721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69da32-0761-4237-868c-2ce9d0965c97 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.706245 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69da32-0761-4237-868c-2ce9d0965c97 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.709895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 16/31] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:35:54.713663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69da32-0761-4237-868c-2ce9d0965c97 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.738801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69da32-0761-4237-868c-2ce9d0965c97 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:54.747928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ad3cc-6080-4676-8cb3-ea96ba4a2012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:54.749140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ad3cc-6080-4676-8cb3-ea96ba4a2012 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.749635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ad3cc-6080-4676-8cb3-ea96ba4a2012 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.750127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ad3cc-6080-4676-8cb3-ea96ba4a2012 admin admin] PATH_INFO: `/v3/users/8b36880779e54979b4c28d8db11f3446` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.751679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ad3cc-6080-4676-8cb3-ea96ba4a2012 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b36880779e54979b4c28d8db11f3446)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:54.753920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ad3cc-6080-4676-8cb3-ea96ba4a2012 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:54.756166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 17/32] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:35:54 2022] GET /identity/v3/users/8b36880779e54979b4c28d8db11f3446 => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:54.757651 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925050f8-4ff3-4aa2-85c6-d1224b16c98f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.759016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925050f8-4ff3-4aa2-85c6-d1224b16c98f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.759809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925050f8-4ff3-4aa2-85c6-d1224b16c98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.766146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 16/33] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:35:54.767069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36acf03-9878-4c7b-9372-8123ede53ac5 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.779681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-925050f8-4ff3-4aa2-85c6-d1224b16c98f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:54.781517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-925050f8-4ff3-4aa2-85c6-d1224b16c98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:54.787458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36acf03-9878-4c7b-9372-8123ede53ac5 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:54.791035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 18/34] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:35:54.806054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925050f8-4ff3-4aa2-85c6-d1224b16c98f None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.808307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a31b0-425f-4f14-81a7-7699803f80e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:54.809134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a31b0-425f-4f14-81a7-7699803f80e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.809425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a31b0-425f-4f14-81a7-7699803f80e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.809711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a31b0-425f-4f14-81a7-7699803f80e7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.810970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a31b0-425f-4f14-81a7-7699803f80e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:54.812760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a31b0-425f-4f14-81a7-7699803f80e7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:54.815100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 17/35] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:35:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:54.818732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925050f8-4ff3-4aa2-85c6-d1224b16c98f None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:54.820222 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a31b0-425f-4f14-81a7-7699803f80e7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.825282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02e815-1470-4173-9cdc-83df0131d906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:54.826206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02e815-1470-4173-9cdc-83df0131d906 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.826693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02e815-1470-4173-9cdc-83df0131d906 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.827166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02e815-1470-4173-9cdc-83df0131d906 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.828910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02e815-1470-4173-9cdc-83df0131d906 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:54.829460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-fc02e815-1470-4173-9cdc-83df0131d906 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:35:54.829460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:35:54.829460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:35:54.830700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02e815-1470-4173-9cdc-83df0131d906 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:54.839851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a31b0-425f-4f14-81a7-7699803f80e7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:54.845954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a40320-34d9-4345-8aed-c6420c5d5835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:54.847267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a40320-34d9-4345-8aed-c6420c5d5835 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:54.847897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a40320-34d9-4345-8aed-c6420c5d5835 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:54.848498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a40320-34d9-4345-8aed-c6420c5d5835 admin admin] PATH_INFO: `/v3/domains/default/users/8b36880779e54979b4c28d8db11f3446/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:54.852169 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a40320-34d9-4345-8aed-c6420c5d5835 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8b36880779e54979b4c28d8db11f3446, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:54.853659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-e8a40320-34d9-4345-8aed-c6420c5d5835 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:35:54.853659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:35:54.853659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:35:54.856263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a40320-34d9-4345-8aed-c6420c5d5835 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:54.866524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 19/36] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:35:54 2022] POST /identity/v3/roles => generated 225 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:35:54.867260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02e815-1470-4173-9cdc-83df0131d906 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:54.900011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02e815-1470-4173-9cdc-83df0131d906 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:55.000944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a41471-0344-41a6-b05a-6ca79c638645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:55.001940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a41471-0344-41a6-b05a-6ca79c638645 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:55.002414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a41471-0344-41a6-b05a-6ca79c638645 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:55.002870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a41471-0344-41a6-b05a-6ca79c638645 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:55.003834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a41471-0344-41a6-b05a-6ca79c638645 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:55.005687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a41471-0344-41a6-b05a-6ca79c638645 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:55.005803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 18/37] 10.222.0.48 () {58 vars in 1382 bytes} [Thu Jan 27 16:35:54 2022] PUT /identity/v3/domains/default/users/8b36880779e54979b4c28d8db11f3446/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:35:55.046076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 20/38] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:35:54 2022] POST /identity/v3/roles => generated 219 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:35:55.322046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42336ead-8fbd-4672-859e-587d7e725088 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:55.322586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42336ead-8fbd-4672-859e-587d7e725088 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:55.322661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42336ead-8fbd-4672-859e-587d7e725088 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:55.329325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 19/39] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:35:55.335343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149c22-8a38-4260-aeca-57354ae38f58 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:55.335873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149c22-8a38-4260-aeca-57354ae38f58 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:55.336042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149c22-8a38-4260-aeca-57354ae38f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:55.355951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-40149c22-8a38-4260-aeca-57354ae38f58 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:55.357162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-40149c22-8a38-4260-aeca-57354ae38f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:55.364757 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 21/40] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:35:55.388291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42336ead-8fbd-4672-859e-587d7e725088 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:55.401007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42336ead-8fbd-4672-859e-587d7e725088 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:55.405493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c727d73-e7b6-400f-9c3d-79146088bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:55.406154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727d73-e7b6-400f-9c3d-79146088bbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:55.406437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727d73-e7b6-400f-9c3d-79146088bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:55.406713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727d73-e7b6-400f-9c3d-79146088bbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:55.407501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c727d73-e7b6-400f-9c3d-79146088bbc5 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:55.408726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-2c727d73-e7b6-400f-9c3d-79146088bbc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:35:55.408726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:35:55.408726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:35:55.409645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c727d73-e7b6-400f-9c3d-79146088bbc5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:55.426356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:35:55 2022] POST /identity/v3/roles => generated 223 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:35:55.581435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e129b1-8530-4404-8780-0c0cc903c503 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:55.581435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e129b1-8530-4404-8780-0c0cc903c503 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:55.581435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e129b1-8530-4404-8780-0c0cc903c503 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:55.582574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 22/42] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:35:55.588623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ffa77-b73a-4779-b3b3-9f0804cb19eb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:55.588917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ffa77-b73a-4779-b3b3-9f0804cb19eb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:55.589200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ffa77-b73a-4779-b3b3-9f0804cb19eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:55.608418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-624ffa77-b73a-4779-b3b3-9f0804cb19eb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:55.609939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-624ffa77-b73a-4779-b3b3-9f0804cb19eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:55.618071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:35:55.641168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e129b1-8530-4404-8780-0c0cc903c503 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:55.654445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e129b1-8530-4404-8780-0c0cc903c503 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:55.658562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8242eb7-e72f-4663-aa82-b5b971401159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:55.659336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242eb7-e72f-4663-aa82-b5b971401159 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:55.659647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242eb7-e72f-4663-aa82-b5b971401159 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:55.659927 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242eb7-e72f-4663-aa82-b5b971401159 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:55.661100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8242eb7-e72f-4663-aa82-b5b971401159 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:55.662814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8242eb7-e72f-4663-aa82-b5b971401159 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:55.664714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 23/44] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:35:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:35:55.670046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ffa77-b73a-4779-b3b3-9f0804cb19eb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:55.678872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ffa77-b73a-4779-b3b3-9f0804cb19eb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:55.684126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9212e0c-c317-4911-8ba6-b9cb6d7f456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:55.684793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9212e0c-c317-4911-8ba6-b9cb6d7f456c admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:55.685086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9212e0c-c317-4911-8ba6-b9cb6d7f456c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:55.685379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9212e0c-c317-4911-8ba6-b9cb6d7f456c admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:55.686125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9212e0c-c317-4911-8ba6-b9cb6d7f456c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:55.687159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-f9212e0c-c317-4911-8ba6-b9cb6d7f456c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:35:55.687159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:35:55.687159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:35:55.688449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9212e0c-c317-4911-8ba6-b9cb6d7f456c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:55.714940 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:35:55 2022] POST /identity/v3/projects => generated 312 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:35:57.306742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34da79-3ac2-46db-b292-2cc90b95776a None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:57.307262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34da79-3ac2-46db-b292-2cc90b95776a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:57.307347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34da79-3ac2-46db-b292-2cc90b95776a None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:57.309095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 24/46] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:35:57.314400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074469-07cd-4109-b2ac-58caf2b563c0 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:57.314807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074469-07cd-4109-b2ac-58caf2b563c0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:57.314966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07074469-07cd-4109-b2ac-58caf2b563c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:57.332995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-07074469-07cd-4109-b2ac-58caf2b563c0 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:57.334186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-07074469-07cd-4109-b2ac-58caf2b563c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:57.389308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 23/47] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:35:57.412597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34da79-3ac2-46db-b292-2cc90b95776a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:57.425240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34da79-3ac2-46db-b292-2cc90b95776a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:57.429454 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925a06-0fd1-4b24-8755-b12f3366b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:57.430320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925a06-0fd1-4b24-8755-b12f3366b468 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:57.431204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925a06-0fd1-4b24-8755-b12f3366b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:57.431485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32925a06-0fd1-4b24-8755-b12f3366b468 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:57.441435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32925a06-0fd1-4b24-8755-b12f3366b468 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:35:57.448352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-32925a06-0fd1-4b24-8755-b12f3366b468 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:35:57.449505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:35:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:35:57.455060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074469-07cd-4109-b2ac-58caf2b563c0 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:57.464214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07074469-07cd-4109-b2ac-58caf2b563c0 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:57.468547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:57.469217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:57.469506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:57.469787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:57.470559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:35:57.470871 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:57.471929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:35:57.471929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:35:57.471929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:35:57.472854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:57.486132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 24/49] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:35:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:57.491500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925a06-0fd1-4b24-8755-b12f3366b468 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:57.502569 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32925a06-0fd1-4b24-8755-b12f3366b468 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:57.506861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685120d-8ba4-4d73-bee3-227c141c0e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:57.507743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685120d-8ba4-4d73-bee3-227c141c0e0a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:57.508029 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685120d-8ba4-4d73-bee3-227c141c0e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:57.508309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685120d-8ba4-4d73-bee3-227c141c0e0a admin admin] PATH_INFO: `/v3/users/8b36880779e54979b4c28d8db11f3446` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:57.509509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685120d-8ba4-4d73-bee3-227c141c0e0a admin admin] RBAC: Authorizing `identity:get_user(user_id=8b36880779e54979b4c28d8db11f3446)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:57.511332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685120d-8ba4-4d73-bee3-227c141c0e0a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:57.512935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 26/50] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:35:57 2022] GET /identity/v3/users/8b36880779e54979b4c28d8db11f3446 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:35:57.518124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:57.528190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfcaf6-224b-4b9d-abb7-4ab4371203ce admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:57.532599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d2811-ab28-451b-9e97-9758385c6c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:57.533381 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d2811-ab28-451b-9e97-9758385c6c2e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:57.533671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d2811-ab28-451b-9e97-9758385c6c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:57.533954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d2811-ab28-451b-9e97-9758385c6c2e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:57.535140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d2811-ab28-451b-9e97-9758385c6c2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:57.536888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d2811-ab28-451b-9e97-9758385c6c2e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:57.538459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 25/51] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:35:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:57.545835 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685120d-8ba4-4d73-bee3-227c141c0e0a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:57.556319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685120d-8ba4-4d73-bee3-227c141c0e0a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:57.560860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef252b9-34eb-4512-ab8a-043145335ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:57.561456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef252b9-34eb-4512-ab8a-043145335ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:57.561743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef252b9-34eb-4512-ab8a-043145335ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:57.562024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef252b9-34eb-4512-ab8a-043145335ea8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:57.562869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef252b9-34eb-4512-ab8a-043145335ea8 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.domain.id=default, user.id=8b36880779e54979b4c28d8db11f3446) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:35:57.563188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef252b9-34eb-4512-ab8a-043145335ea8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:57.565090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef252b9-34eb-4512-ab8a-043145335ea8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:57.570982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1343 bytes} [Thu Jan 27 16:35:57 2022] GET /identity/v3/role_assignments?user.id=8b36880779e54979b4c28d8db11f3446&scope.domain.id=default&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:57.964392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defd0bb-0339-4f0e-b9d2-015d10fa4884 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:57.964610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defd0bb-0339-4f0e-b9d2-015d10fa4884 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:57.964895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defd0bb-0339-4f0e-b9d2-015d10fa4884 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:57.966663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 26/53] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:35:57.971894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17798559-bb17-447b-8615-199de850be84 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:57.972198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17798559-bb17-447b-8615-199de850be84 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:57.972483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17798559-bb17-447b-8615-199de850be84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:57.990136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-17798559-bb17-447b-8615-199de850be84 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:35:57.991323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-17798559-bb17-447b-8615-199de850be84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:35:57.999183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 28/54] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:35:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:35:58.022290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defd0bb-0339-4f0e-b9d2-015d10fa4884 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:58.035086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defd0bb-0339-4f0e-b9d2-015d10fa4884 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:58.039250 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95302d7-e390-48e3-ad8e-83edf745a07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:58.040846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95302d7-e390-48e3-ad8e-83edf745a07c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:58.041137 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95302d7-e390-48e3-ad8e-83edf745a07c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:58.041419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95302d7-e390-48e3-ad8e-83edf745a07c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:58.042614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95302d7-e390-48e3-ad8e-83edf745a07c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:58.044351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95302d7-e390-48e3-ad8e-83edf745a07c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:58.045910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:35:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:35:58.051087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17798559-bb17-447b-8615-199de850be84 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:35:58.060023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17798559-bb17-447b-8615-199de850be84 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:35:58.064352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485c47-0806-4a0e-95c4-8eaacbbe6a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:35:58.065027 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485c47-0806-4a0e-95c4-8eaacbbe6a49 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:35:58.065314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485c47-0806-4a0e-95c4-8eaacbbe6a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:35:58.065594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485c47-0806-4a0e-95c4-8eaacbbe6a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:35:58.066325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485c47-0806-4a0e-95c4-8eaacbbe6a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:35:58.068298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485c47-0806-4a0e-95c4-8eaacbbe6a49 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:35:58.092760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 29/56] 10.222.0.48 () {60 vars in 1161 bytes} [Thu Jan 27 16:35:58 2022] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:36:00.313406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c43ba-70cf-49fe-b6c3-ca72125ea452 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:00.313923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c43ba-70cf-49fe-b6c3-ca72125ea452 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:00.314007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c43ba-70cf-49fe-b6c3-ca72125ea452 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:00.315787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 28/57] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:00.320949 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef7fee-f993-48a7-88cd-e28294867dc8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:00.321561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef7fee-f993-48a7-88cd-e28294867dc8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:00.321561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef7fee-f993-48a7-88cd-e28294867dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:00.339308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-77ef7fee-f993-48a7-88cd-e28294867dc8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:00.340537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-77ef7fee-f993-48a7-88cd-e28294867dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:00.395253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 30/58] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:00.420520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c43ba-70cf-49fe-b6c3-ca72125ea452 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:00.432506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c43ba-70cf-49fe-b6c3-ca72125ea452 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:00.436740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86161f0-c239-403c-8b79-307dce127495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:00.437510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86161f0-c239-403c-8b79-307dce127495 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:00.437801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86161f0-c239-403c-8b79-307dce127495 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:00.438086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86161f0-c239-403c-8b79-307dce127495 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:00.439278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86161f0-c239-403c-8b79-307dce127495 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:00.441031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86161f0-c239-403c-8b79-307dce127495 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:00.442618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:00.448064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef7fee-f993-48a7-88cd-e28294867dc8 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:00.456674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef7fee-f993-48a7-88cd-e28294867dc8 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:00.460983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca59d4d-e9a0-411b-b6d4-86ee04c98537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:00.461631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca59d4d-e9a0-411b-b6d4-86ee04c98537 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:00.462528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca59d4d-e9a0-411b-b6d4-86ee04c98537 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:00.462816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca59d4d-e9a0-411b-b6d4-86ee04c98537 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:00.463538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca59d4d-e9a0-411b-b6d4-86ee04c98537 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:00.464586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-5ca59d4d-e9a0-411b-b6d4-86ee04c98537 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:00.464586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:00.464586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:00.465810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca59d4d-e9a0-411b-b6d4-86ee04c98537 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:00.490110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 31/60] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:00 2022] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:03.746665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab892563-3246-46b5-9eb2-6e29ca022990 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:03.747834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab892563-3246-46b5-9eb2-6e29ca022990 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:03.748353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab892563-3246-46b5-9eb2-6e29ca022990 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:03.750430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 30/61] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:03.756202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a081b-d4bd-4875-9324-65c089a7a93e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:03.757142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a081b-d4bd-4875-9324-65c089a7a93e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:03.757631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a081b-d4bd-4875-9324-65c089a7a93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:03.784648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ce6a081b-d4bd-4875-9324-65c089a7a93e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:03.785896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ce6a081b-d4bd-4875-9324-65c089a7a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:03.799305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 32/62] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:03.823935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab892563-3246-46b5-9eb2-6e29ca022990 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:03.842451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab892563-3246-46b5-9eb2-6e29ca022990 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:03.851634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339aed0-80cd-4cdf-a2fb-5445220a794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:03.852742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339aed0-80cd-4cdf-a2fb-5445220a794b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:03.853911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339aed0-80cd-4cdf-a2fb-5445220a794b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:03.854417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339aed0-80cd-4cdf-a2fb-5445220a794b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:03.872501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339aed0-80cd-4cdf-a2fb-5445220a794b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:03.879797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-1339aed0-80cd-4cdf-a2fb-5445220a794b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:03.881259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 31/63] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:03.887322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a081b-d4bd-4875-9324-65c089a7a93e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:03.901744 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a081b-d4bd-4875-9324-65c089a7a93e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:03.911704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa08fb5-cb1a-4137-96cf-eb8b4c84d307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:03.912382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa08fb5-cb1a-4137-96cf-eb8b4c84d307 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:03.912670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa08fb5-cb1a-4137-96cf-eb8b4c84d307 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:03.912951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa08fb5-cb1a-4137-96cf-eb8b4c84d307 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:03.913727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa08fb5-cb1a-4137-96cf-eb8b4c84d307 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:03.914039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa08fb5-cb1a-4137-96cf-eb8b4c84d307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:03.916398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa08fb5-cb1a-4137-96cf-eb8b4c84d307 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:03.931873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 33/64] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:03.937581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339aed0-80cd-4cdf-a2fb-5445220a794b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:03.952660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339aed0-80cd-4cdf-a2fb-5445220a794b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:03.962039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849fb25-2feb-4ffc-abaf-5586d2ad504c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:03.963807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849fb25-2feb-4ffc-abaf-5586d2ad504c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:03.964318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849fb25-2feb-4ffc-abaf-5586d2ad504c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:03.964809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849fb25-2feb-4ffc-abaf-5586d2ad504c admin admin] PATH_INFO: `/v3/users/fe303c155a5746d58d2ffed983e1b866` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:03.990111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849fb25-2feb-4ffc-abaf-5586d2ad504c admin admin] RBAC: Authorizing `identity:get_user(user_id=fe303c155a5746d58d2ffed983e1b866)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:03.992690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849fb25-2feb-4ffc-abaf-5586d2ad504c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:03.995377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 32/65] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:03 2022] GET /identity/v3/users/fe303c155a5746d58d2ffed983e1b866 => generated 275 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.001194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa08fb5-cb1a-4137-96cf-eb8b4c84d307 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.012305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa08fb5-cb1a-4137-96cf-eb8b4c84d307 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.022096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c0801-5575-44f5-ac6c-b59f1772fcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.023010 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c0801-5575-44f5-ac6c-b59f1772fcdd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.023510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c0801-5575-44f5-ac6c-b59f1772fcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.024031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c0801-5575-44f5-ac6c-b59f1772fcdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.033528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c0801-5575-44f5-ac6c-b59f1772fcdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.035682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c0801-5575-44f5-ac6c-b59f1772fcdd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.045922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 34/66] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:04.052023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598e58c-e286-428e-819c-0b9ab033d696 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.052602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598e58c-e286-428e-819c-0b9ab033d696 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.053088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598e58c-e286-428e-819c-0b9ab033d696 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.053206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c0801-5575-44f5-ac6c-b59f1772fcdd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.055179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 33/67] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:04.062859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0e2b-4b24-474e-a642-30f2ed24ad29 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.063447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0e2b-4b24-474e-a642-30f2ed24ad29 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.063970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c0e2b-4b24-474e-a642-30f2ed24ad29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.070019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c0801-5575-44f5-ac6c-b59f1772fcdd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.085786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a9da0-c812-4604-a12e-cb796c40211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.087003 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a9da0-c812-4604-a12e-cb796c40211c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.088148 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a9da0-c812-4604-a12e-cb796c40211c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.088647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a9da0-c812-4604-a12e-cb796c40211c admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.092971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a9da0-c812-4604-a12e-cb796c40211c admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.095306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a9da0-c812-4604-a12e-cb796c40211c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.096479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ac8c0e2b-4b24-474e-a642-30f2ed24ad29 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:04.098407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 35/68] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.099879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ac8c0e2b-4b24-474e-a642-30f2ed24ad29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:04.108515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a9da0-c812-4604-a12e-cb796c40211c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.118825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 34/69] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:04.123716 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a9da0-c812-4604-a12e-cb796c40211c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.133053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d488db5-3356-4367-95e6-80634a3a11e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.134514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488db5-3356-4367-95e6-80634a3a11e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.135113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488db5-3356-4367-95e6-80634a3a11e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.135642 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d488db5-3356-4367-95e6-80634a3a11e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.136701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488db5-3356-4367-95e6-80634a3a11e4 admin admin] RBAC: Adding query filter params (role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=9fb3d018836e4765a6346dd80809dc63, user.id=fe303c155a5746d58d2ffed983e1b866) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:04.137234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488db5-3356-4367-95e6-80634a3a11e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.139353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d488db5-3356-4367-95e6-80634a3a11e4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.144828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae247333-6ada-49d6-9dad-2a8c900aa798 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.145118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae247333-6ada-49d6-9dad-2a8c900aa798 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.145400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae247333-6ada-49d6-9dad-2a8c900aa798 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.146484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 36/70] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/role_assignments?user.id=fe303c155a5746d58d2ffed983e1b866&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.147540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 35/71] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:04.157287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dda35-0e55-41fe-bf6c-c14cb1e8746c None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.157952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dda35-0e55-41fe-bf6c-c14cb1e8746c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.158546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dda35-0e55-41fe-bf6c-c14cb1e8746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.183129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-3b8dda35-0e55-41fe-bf6c-c14cb1e8746c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:04.184849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3b8dda35-0e55-41fe-bf6c-c14cb1e8746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:04.190910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae247333-6ada-49d6-9dad-2a8c900aa798 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.198691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 37/72] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:04.216437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae247333-6ada-49d6-9dad-2a8c900aa798 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.223320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dda35-0e55-41fe-bf6c-c14cb1e8746c None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.225146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ea896-ef21-4e5e-96c7-9ca22d8aaf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.225971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ea896-ef21-4e5e-96c7-9ca22d8aaf6d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.226258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ea896-ef21-4e5e-96c7-9ca22d8aaf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.226550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ea896-ef21-4e5e-96c7-9ca22d8aaf6d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.234607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dda35-0e55-41fe-bf6c-c14cb1e8746c None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.239839 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf1458-3909-410d-8047-3c5c3c6b0548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.241054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf1458-3909-410d-8047-3c5c3c6b0548 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.241549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf1458-3909-410d-8047-3c5c3c6b0548 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.242092 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf1458-3909-410d-8047-3c5c3c6b0548 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.246985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ea896-ef21-4e5e-96c7-9ca22d8aaf6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:04.254245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-431ea896-ef21-4e5e-96c7-9ca22d8aaf6d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:04.254675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf1458-3909-410d-8047-3c5c3c6b0548 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:04.255463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:04.262525 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ea896-ef21-4e5e-96c7-9ca22d8aaf6d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.264949 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-47cf1458-3909-410d-8047-3c5c3c6b0548 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:04.266473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 38/74] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:04.272323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf1458-3909-410d-8047-3c5c3c6b0548 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.282486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ea896-ef21-4e5e-96c7-9ca22d8aaf6d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.290643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf1458-3909-410d-8047-3c5c3c6b0548 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.293356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7623d-79c3-4eae-a177-1c7ef178dff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.294048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7623d-79c3-4eae-a177-1c7ef178dff3 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.294335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7623d-79c3-4eae-a177-1c7ef178dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.294615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7623d-79c3-4eae-a177-1c7ef178dff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.295397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7623d-79c3-4eae-a177-1c7ef178dff3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:04.295741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7623d-79c3-4eae-a177-1c7ef178dff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.297586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7623d-79c3-4eae-a177-1c7ef178dff3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.312302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:04.316536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1113609-2d8b-4ce0-9fd9-7bf3feb9a9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.317245 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1113609-2d8b-4ce0-9fd9-7bf3feb9a9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.317529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1113609-2d8b-4ce0-9fd9-7bf3feb9a9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.317745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7623d-79c3-4eae-a177-1c7ef178dff3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.317852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1113609-2d8b-4ce0-9fd9-7bf3feb9a9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.318581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1113609-2d8b-4ce0-9fd9-7bf3feb9a9b9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:04.318892 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1113609-2d8b-4ce0-9fd9-7bf3feb9a9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.320587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1113609-2d8b-4ce0-9fd9-7bf3feb9a9b9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.337026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 39/76] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.340600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7623d-79c3-4eae-a177-1c7ef178dff3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.346437 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1113609-2d8b-4ce0-9fd9-7bf3feb9a9b9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.358533 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f6651-788d-400c-ab81-3cb7e51448c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.359440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f6651-788d-400c-ab81-3cb7e51448c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.359751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f6651-788d-400c-ab81-3cb7e51448c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.360036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f6651-788d-400c-ab81-3cb7e51448c8 admin admin] PATH_INFO: `/v3/users/fe303c155a5746d58d2ffed983e1b866` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.361626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f6651-788d-400c-ab81-3cb7e51448c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe303c155a5746d58d2ffed983e1b866)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.364011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f6651-788d-400c-ab81-3cb7e51448c8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.366376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1113609-2d8b-4ce0-9fd9-7bf3feb9a9b9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.371846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 38/77] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/users/fe303c155a5746d58d2ffed983e1b866 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.373431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f6651-788d-400c-ab81-3cb7e51448c8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.378476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a402fa-1b58-4d50-90cf-f7f90b84a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.380115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a402fa-1b58-4d50-90cf-f7f90b84a1ab admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.380678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a402fa-1b58-4d50-90cf-f7f90b84a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.381197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a402fa-1b58-4d50-90cf-f7f90b84a1ab admin admin] PATH_INFO: `/v3/users/8b36880779e54979b4c28d8db11f3446` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.382867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a402fa-1b58-4d50-90cf-f7f90b84a1ab admin admin] RBAC: Authorizing `identity:get_user(user_id=8b36880779e54979b4c28d8db11f3446)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.385284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a402fa-1b58-4d50-90cf-f7f90b84a1ab admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.388201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 40/78] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/users/8b36880779e54979b4c28d8db11f3446 => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.390855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f6651-788d-400c-ab81-3cb7e51448c8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.399994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aec62-bf70-4190-b8b8-5569cfd1cdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.400487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a402fa-1b58-4d50-90cf-f7f90b84a1ab admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.401041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aec62-bf70-4190-b8b8-5569cfd1cdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.401332 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aec62-bf70-4190-b8b8-5569cfd1cdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.401608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aec62-bf70-4190-b8b8-5569cfd1cdd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.410544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aec62-bf70-4190-b8b8-5569cfd1cdd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.412378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aec62-bf70-4190-b8b8-5569cfd1cdd7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.412940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a402fa-1b58-4d50-90cf-f7f90b84a1ab admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.420696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8ac05-f116-4536-90d3-a9449d1b7bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.421704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8ac05-f116-4536-90d3-a9449d1b7bdc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.422201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8ac05-f116-4536-90d3-a9449d1b7bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.422741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8ac05-f116-4536-90d3-a9449d1b7bdc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.423947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 39/79] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:04.429849 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aec62-bf70-4190-b8b8-5569cfd1cdd7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.433387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8ac05-f116-4536-90d3-a9449d1b7bdc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.435241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8ac05-f116-4536-90d3-a9449d1b7bdc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.439191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aec62-bf70-4190-b8b8-5569cfd1cdd7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.444794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 41/80] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:04.447719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42f1b0-faae-4efe-a51b-87e155907e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.448656 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42f1b0-faae-4efe-a51b-87e155907e19 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.448887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42f1b0-faae-4efe-a51b-87e155907e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.449167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42f1b0-faae-4efe-a51b-87e155907e19 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.450529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42f1b0-faae-4efe-a51b-87e155907e19 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.452281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8ac05-f116-4536-90d3-a9449d1b7bdc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.452736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42f1b0-faae-4efe-a51b-87e155907e19 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.454480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.455794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07834f8-396c-4bf1-afa0-312ecd58576c None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.456086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07834f8-396c-4bf1-afa0-312ecd58576c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.456369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07834f8-396c-4bf1-afa0-312ecd58576c None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.458045 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 41/82] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:04.461554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8ac05-f116-4536-90d3-a9449d1b7bdc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.463647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07834f8-396c-4bf1-afa0-312ecd58576c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.466966 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9698a1b-af85-4d3d-bfbf-301fbfcbf68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.467907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698a1b-af85-4d3d-bfbf-301fbfcbf68d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.468195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698a1b-af85-4d3d-bfbf-301fbfcbf68d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.468479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9698a1b-af85-4d3d-bfbf-301fbfcbf68d admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.469692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698a1b-af85-4d3d-bfbf-301fbfcbf68d admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.471831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9698a1b-af85-4d3d-bfbf-301fbfcbf68d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.473506 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 42/83] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.474681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6401-9530-4d61-aed8-32e8208020fe None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.474972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6401-9530-4d61-aed8-32e8208020fe None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.475254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda6401-9530-4d61-aed8-32e8208020fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.477296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07834f8-396c-4bf1-afa0-312ecd58576c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.482529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.483504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.484038 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.484501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.485580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] RBAC: Adding query filter params (role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=9fb3d018836e4765a6346dd80809dc63, user.id=fe303c155a5746d58d2ffed983e1b866) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:04.486118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.487674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:04.487674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:36:04.487674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:36:04.489200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.493016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2dda6401-9530-4d61-aed8-32e8208020fe None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:04.494746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2dda6401-9530-4d61-aed8-32e8208020fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:04.497976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 42/84] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/role_assignments?user.id=fe303c155a5746d58d2ffed983e1b866&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.499090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.503046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:04.514728 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9441f3-d25e-4cfe-a50b-3d1126dcf7ce admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.528055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5418c7c-a9cc-445d-9063-9e7591152f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.529009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5418c7c-a9cc-445d-9063-9e7591152f11 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.529310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5418c7c-a9cc-445d-9063-9e7591152f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.529598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5418c7c-a9cc-445d-9063-9e7591152f11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.530483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5418c7c-a9cc-445d-9063-9e7591152f11 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=9fb3d018836e4765a6346dd80809dc63, user.id=8b36880779e54979b4c28d8db11f3446) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:04.530807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5418c7c-a9cc-445d-9063-9e7591152f11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.532814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5418c7c-a9cc-445d-9063-9e7591152f11 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.540773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6401-9530-4d61-aed8-32e8208020fe None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.545359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 43/86] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/role_assignments?user.id=8b36880779e54979b4c28d8db11f3446&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.553907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda6401-9530-4d61-aed8-32e8208020fe None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.560135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25305a76-6488-4b0c-a70f-8444ac7cf49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.561362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25305a76-6488-4b0c-a70f-8444ac7cf49a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.561899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25305a76-6488-4b0c-a70f-8444ac7cf49a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.562426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25305a76-6488-4b0c-a70f-8444ac7cf49a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.564116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25305a76-6488-4b0c-a70f-8444ac7cf49a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.567194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25305a76-6488-4b0c-a70f-8444ac7cf49a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.569803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 44/87] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.576227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5418c7c-a9cc-445d-9063-9e7591152f11 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.587847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5418c7c-a9cc-445d-9063-9e7591152f11 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.593652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca652-322f-48c5-b31d-0133e86fd3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.594897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca652-322f-48c5-b31d-0133e86fd3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.595393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca652-322f-48c5-b31d-0133e86fd3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.595945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca652-322f-48c5-b31d-0133e86fd3f1 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.596934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ca652-322f-48c5-b31d-0133e86fd3f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.598292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-a31ca652-322f-48c5-b31d-0133e86fd3f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:04.598292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:36:04.598292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:36:04.599992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ca652-322f-48c5-b31d-0133e86fd3f1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.642621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 44/88] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:04 2022] POST /identity/v3/users => generated 289 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:04.658791 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf8771-69e3-49ab-adeb-63a385e5f2ff None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.659457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf8771-69e3-49ab-adeb-63a385e5f2ff None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.660012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf8771-69e3-49ab-adeb-63a385e5f2ff None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.662235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 45/89] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:04.669339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2118-4782-49c2-b145-b83453decac9 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.669983 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2118-4782-49c2-b145-b83453decac9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.670463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef2118-4782-49c2-b145-b83453decac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.696944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-09ef2118-4782-49c2-b145-b83453decac9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:04.698745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-09ef2118-4782-49c2-b145-b83453decac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:04.711275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 45/90] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:04.738574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf8771-69e3-49ab-adeb-63a385e5f2ff None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.752822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf8771-69e3-49ab-adeb-63a385e5f2ff None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.758120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a1590-29d3-4f97-8279-8bdd86a9c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.759912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a1590-29d3-4f97-8279-8bdd86a9c360 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.760353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a1590-29d3-4f97-8279-8bdd86a9c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.760798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1a1590-29d3-4f97-8279-8bdd86a9c360 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.774425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1a1590-29d3-4f97-8279-8bdd86a9c360 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:04.782843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-ca1a1590-29d3-4f97-8279-8bdd86a9c360 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:04.784808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:04.791284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef2118-4782-49c2-b145-b83453decac9 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.804734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef2118-4782-49c2-b145-b83453decac9 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.810497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919696b5-9c35-43c7-81bb-66c6802b75cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.811437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919696b5-9c35-43c7-81bb-66c6802b75cc admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.811913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919696b5-9c35-43c7-81bb-66c6802b75cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.812335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919696b5-9c35-43c7-81bb-66c6802b75cc admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.813366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919696b5-9c35-43c7-81bb-66c6802b75cc admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:04.813846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919696b5-9c35-43c7-81bb-66c6802b75cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.815676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919696b5-9c35-43c7-81bb-66c6802b75cc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.826774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 46/92] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.832753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a1590-29d3-4f97-8279-8bdd86a9c360 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.844229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1a1590-29d3-4f97-8279-8bdd86a9c360 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.848895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1675c5-802d-4b9c-8ca8-7d8a25e863ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.849778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1675c5-802d-4b9c-8ca8-7d8a25e863ba admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.850058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1675c5-802d-4b9c-8ca8-7d8a25e863ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.850334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1675c5-802d-4b9c-8ca8-7d8a25e863ba admin admin] PATH_INFO: `/v3/users/fe303c155a5746d58d2ffed983e1b866` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.851696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1675c5-802d-4b9c-8ca8-7d8a25e863ba admin admin] RBAC: Authorizing `identity:get_user(user_id=fe303c155a5746d58d2ffed983e1b866)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.854891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1675c5-802d-4b9c-8ca8-7d8a25e863ba admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.856834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 47/93] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/users/fe303c155a5746d58d2ffed983e1b866 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.862365 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919696b5-9c35-43c7-81bb-66c6802b75cc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.873518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919696b5-9c35-43c7-81bb-66c6802b75cc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.878309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf6c53-eeeb-40df-ae6e-df0a183afadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.879034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf6c53-eeeb-40df-ae6e-df0a183afadf admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.879319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf6c53-eeeb-40df-ae6e-df0a183afadf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.879674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf6c53-eeeb-40df-ae6e-df0a183afadf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.890947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf6c53-eeeb-40df-ae6e-df0a183afadf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.892833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf6c53-eeeb-40df-ae6e-df0a183afadf admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.903713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 47/94] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:04.909444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1675c5-802d-4b9c-8ca8-7d8a25e863ba admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.919867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1675c5-802d-4b9c-8ca8-7d8a25e863ba admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.924530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd062433-6149-4545-8d97-6458a43ca3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.925383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd062433-6149-4545-8d97-6458a43ca3db admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.925667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd062433-6149-4545-8d97-6458a43ca3db admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.925945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd062433-6149-4545-8d97-6458a43ca3db admin admin] PATH_INFO: `/v3/projects/676050fbd0d54652b68674deada9cbd3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.927207 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd062433-6149-4545-8d97-6458a43ca3db admin admin] RBAC: Authorizing `identity:get_project(project_id=676050fbd0d54652b68674deada9cbd3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.929292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd062433-6149-4545-8d97-6458a43ca3db admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.931546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 48/95] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/projects/676050fbd0d54652b68674deada9cbd3 => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:04.937482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf6c53-eeeb-40df-ae6e-df0a183afadf admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:04.946777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf6c53-eeeb-40df-ae6e-df0a183afadf admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:04.952258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416851ec-0a7c-4b95-934f-1562977c4101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:04.953024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416851ec-0a7c-4b95-934f-1562977c4101 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:04.953310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416851ec-0a7c-4b95-934f-1562977c4101 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:04.953590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416851ec-0a7c-4b95-934f-1562977c4101 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:04.954442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416851ec-0a7c-4b95-934f-1562977c4101 admin admin] RBAC: Adding query filter params (role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=676050fbd0d54652b68674deada9cbd3, user.id=fe303c155a5746d58d2ffed983e1b866) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:04.954759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416851ec-0a7c-4b95-934f-1562977c4101 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:04.956745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416851ec-0a7c-4b95-934f-1562977c4101 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:04.963654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 48/96] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:04 2022] GET /identity/v3/role_assignments?user.id=fe303c155a5746d58d2ffed983e1b866&scope.project.id=676050fbd0d54652b68674deada9cbd3&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:07.042388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c832815-d052-401e-93d8-b3f403ae2c0e None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.042939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c832815-d052-401e-93d8-b3f403ae2c0e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.042939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c832815-d052-401e-93d8-b3f403ae2c0e None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.044879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 49/97] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:07.050614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9faa1-5474-4096-88e6-15798338b1bf None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.051096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9faa1-5474-4096-88e6-15798338b1bf None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.051199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9faa1-5474-4096-88e6-15798338b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.076610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-cad9faa1-5474-4096-88e6-15798338b1bf None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:07.077825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-cad9faa1-5474-4096-88e6-15798338b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:07.093504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 49/98] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:07.138233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c832815-d052-401e-93d8-b3f403ae2c0e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.157061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c832815-d052-401e-93d8-b3f403ae2c0e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.161549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c52393-d47a-4c21-92d4-214a975545e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.162345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c52393-d47a-4c21-92d4-214a975545e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.162633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c52393-d47a-4c21-92d4-214a975545e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.162913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c52393-d47a-4c21-92d4-214a975545e3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.182132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c52393-d47a-4c21-92d4-214a975545e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:07.189034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-55c52393-d47a-4c21-92d4-214a975545e3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:07.195791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9faa1-5474-4096-88e6-15798338b1bf None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.202059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 50/99] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:07.213457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9faa1-5474-4096-88e6-15798338b1bf None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.223643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b98a1-7286-4f7e-ba80-fc6f507ce6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.224327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b98a1-7286-4f7e-ba80-fc6f507ce6ed admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.224614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b98a1-7286-4f7e-ba80-fc6f507ce6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.224951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b98a1-7286-4f7e-ba80-fc6f507ce6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.225727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b98a1-7286-4f7e-ba80-fc6f507ce6ed admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:07.226036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b98a1-7286-4f7e-ba80-fc6f507ce6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:07.227737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b98a1-7286-4f7e-ba80-fc6f507ce6ed admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:07.243076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 50/100] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:07.248964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c52393-d47a-4c21-92d4-214a975545e3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.258703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c52393-d47a-4c21-92d4-214a975545e3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.267715 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bc3ae-6a5d-4aa0-931e-0a1e0287c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.268593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bc3ae-6a5d-4aa0-931e-0a1e0287c27e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.268878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bc3ae-6a5d-4aa0-931e-0a1e0287c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.269155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0bc3ae-6a5d-4aa0-931e-0a1e0287c27e admin admin] PATH_INFO: `/v3/users/fe303c155a5746d58d2ffed983e1b866` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.276634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bc3ae-6a5d-4aa0-931e-0a1e0287c27e admin admin] RBAC: Authorizing `identity:get_user(user_id=fe303c155a5746d58d2ffed983e1b866)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:07.278817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0bc3ae-6a5d-4aa0-931e-0a1e0287c27e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:07.280747 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 51/101] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:07 2022] GET /identity/v3/users/fe303c155a5746d58d2ffed983e1b866 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:07.286427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b98a1-7286-4f7e-ba80-fc6f507ce6ed admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.298609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b98a1-7286-4f7e-ba80-fc6f507ce6ed admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.309216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d910a02-77f7-4240-be46-6ee5c98eca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.310145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d910a02-77f7-4240-be46-6ee5c98eca94 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.310434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d910a02-77f7-4240-be46-6ee5c98eca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.310715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d910a02-77f7-4240-be46-6ee5c98eca94 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.316351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d910a02-77f7-4240-be46-6ee5c98eca94 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:07.318500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d910a02-77f7-4240-be46-6ee5c98eca94 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:07.320614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 51/102] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:07 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:07.325975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bc3ae-6a5d-4aa0-931e-0a1e0287c27e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.351686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0bc3ae-6a5d-4aa0-931e-0a1e0287c27e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.360911 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81e70d-0d3e-438a-b876-1ed913ed7a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.361873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81e70d-0d3e-438a-b876-1ed913ed7a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.362168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81e70d-0d3e-438a-b876-1ed913ed7a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.362447 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81e70d-0d3e-438a-b876-1ed913ed7a20 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63/users/fe303c155a5746d58d2ffed983e1b866/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.368576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81e70d-0d3e-438a-b876-1ed913ed7a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb3d018836e4765a6346dd80809dc63, user_id=fe303c155a5746d58d2ffed983e1b866, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:07.369964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-7c81e70d-0d3e-438a-b876-1ed913ed7a20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:07.369964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:07.369964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:07.371968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81e70d-0d3e-438a-b876-1ed913ed7a20 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:07.391957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 52/103] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:07 2022] PUT /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63/users/fe303c155a5746d58d2ffed983e1b866/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:07.511382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967677ef-1938-4a57-bef0-9ab7f9e9a354 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.511720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967677ef-1938-4a57-bef0-9ab7f9e9a354 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.511984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967677ef-1938-4a57-bef0-9ab7f9e9a354 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.513928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 52/104] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:07.519607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff9637-e8ef-47bb-9ef0-5cb78a283c76 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.519885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff9637-e8ef-47bb-9ef0-5cb78a283c76 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.520166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff9637-e8ef-47bb-9ef0-5cb78a283c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.548841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-0bff9637-e8ef-47bb-9ef0-5cb78a283c76 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:07.550062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0bff9637-e8ef-47bb-9ef0-5cb78a283c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:07.632299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 53/105] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:07.668743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967677ef-1938-4a57-bef0-9ab7f9e9a354 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.683361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967677ef-1938-4a57-bef0-9ab7f9e9a354 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.691717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dbedd-f59d-4789-9c4f-4dcc89f1bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.692597 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dbedd-f59d-4789-9c4f-4dcc89f1bbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.692880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dbedd-f59d-4789-9c4f-4dcc89f1bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.693154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dbedd-f59d-4789-9c4f-4dcc89f1bbf6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.708574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645dbedd-f59d-4789-9c4f-4dcc89f1bbf6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:07.716612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-645dbedd-f59d-4789-9c4f-4dcc89f1bbf6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:07.717868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 53/106] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:07.723865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff9637-e8ef-47bb-9ef0-5cb78a283c76 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.737315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff9637-e8ef-47bb-9ef0-5cb78a283c76 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.747804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2a8b6-2463-435e-8edf-806398f010cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.748487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2a8b6-2463-435e-8edf-806398f010cb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.748773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2a8b6-2463-435e-8edf-806398f010cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.749051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d2a8b6-2463-435e-8edf-806398f010cb admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.749825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2a8b6-2463-435e-8edf-806398f010cb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:07.750135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2a8b6-2463-435e-8edf-806398f010cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:07.751793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d2a8b6-2463-435e-8edf-806398f010cb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:07.766090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 54/107] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:07.767753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dbedd-f59d-4789-9c4f-4dcc89f1bbf6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.781677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dbedd-f59d-4789-9c4f-4dcc89f1bbf6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.789711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680a60e-2ad6-4e9b-9140-3300b8e85662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.791988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680a60e-2ad6-4e9b-9140-3300b8e85662 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.792647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680a60e-2ad6-4e9b-9140-3300b8e85662 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.793238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680a60e-2ad6-4e9b-9140-3300b8e85662 admin admin] PATH_INFO: `/v3/users/fe303c155a5746d58d2ffed983e1b866` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.796049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680a60e-2ad6-4e9b-9140-3300b8e85662 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe303c155a5746d58d2ffed983e1b866)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:07.798464 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680a60e-2ad6-4e9b-9140-3300b8e85662 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:07.800262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 54/108] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:07 2022] GET /identity/v3/users/fe303c155a5746d58d2ffed983e1b866 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:07.806048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2a8b6-2463-435e-8edf-806398f010cb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.817579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d2a8b6-2463-435e-8edf-806398f010cb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.828129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fcf6d-33f8-40d4-b5b0-eb0835b7fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.829149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcf6d-33f8-40d4-b5b0-eb0835b7fcff admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.829498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcf6d-33f8-40d4-b5b0-eb0835b7fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.829892 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcf6d-33f8-40d4-b5b0-eb0835b7fcff admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.831657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fcf6d-33f8-40d4-b5b0-eb0835b7fcff admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:07.834121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fcf6d-33f8-40d4-b5b0-eb0835b7fcff admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:07.837531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 55/109] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:07 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:07.847856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680a60e-2ad6-4e9b-9140-3300b8e85662 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:07.862567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680a60e-2ad6-4e9b-9140-3300b8e85662 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:07.876453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528f882-968a-4e84-8250-ce11d47a96c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:07.877912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f882-968a-4e84-8250-ce11d47a96c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.878414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f882-968a-4e84-8250-ce11d47a96c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.879051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528f882-968a-4e84-8250-ce11d47a96c6 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63/users/fe303c155a5746d58d2ffed983e1b866/roles/27ceba94bdd34cc790ee9e7b8fb06d57` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.885549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528f882-968a-4e84-8250-ce11d47a96c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb3d018836e4765a6346dd80809dc63, user_id=fe303c155a5746d58d2ffed983e1b866, role_id=27ceba94bdd34cc790ee9e7b8fb06d57)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:07.890578 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528f882-968a-4e84-8250-ce11d47a96c6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:07.911649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 55/110] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:07 2022] PUT /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63/users/fe303c155a5746d58d2ffed983e1b866/roles/27ceba94bdd34cc790ee9e7b8fb06d57 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:36:07.974488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5b3cb-6d5c-4907-8e08-1cd73d3e4eca None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.975162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5b3cb-6d5c-4907-8e08-1cd73d3e4eca None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.975651 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5b3cb-6d5c-4907-8e08-1cd73d3e4eca None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:07.977677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 56/111] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:07.983681 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2b5a9-a66c-40a2-810a-e106e31b6289 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:07.984231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2b5a9-a66c-40a2-810a-e106e31b6289 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:07.984706 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2b5a9-a66c-40a2-810a-e106e31b6289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.016755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3cf2b5a9-a66c-40a2-810a-e106e31b6289 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:08.018329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3cf2b5a9-a66c-40a2-810a-e106e31b6289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:08.093747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 56/112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:08.130003 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5b3cb-6d5c-4907-8e08-1cd73d3e4eca None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.145587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5b3cb-6d5c-4907-8e08-1cd73d3e4eca None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.153523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151a0e-d6c0-4cb0-919f-2d0577dd153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.154926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151a0e-d6c0-4cb0-919f-2d0577dd153f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.155405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151a0e-d6c0-4cb0-919f-2d0577dd153f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.155907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151a0e-d6c0-4cb0-919f-2d0577dd153f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.168713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0151a0e-d6c0-4cb0-919f-2d0577dd153f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:08.176114 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c0151a0e-d6c0-4cb0-919f-2d0577dd153f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:08.178015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 57/113] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:08.184082 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2b5a9-a66c-40a2-810a-e106e31b6289 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.193595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2b5a9-a66c-40a2-810a-e106e31b6289 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.201544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80fadd-622e-448a-9f14-adb333e074ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.202545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80fadd-622e-448a-9f14-adb333e074ec admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.203027 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80fadd-622e-448a-9f14-adb333e074ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.203512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80fadd-622e-448a-9f14-adb333e074ec admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.204558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80fadd-622e-448a-9f14-adb333e074ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:08.205078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80fadd-622e-448a-9f14-adb333e074ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:08.206931 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80fadd-622e-448a-9f14-adb333e074ec admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:08.217135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 57/114] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:08.222664 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151a0e-d6c0-4cb0-919f-2d0577dd153f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.234640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151a0e-d6c0-4cb0-919f-2d0577dd153f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.247230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4223cf-5add-4a84-b20c-9745eb3c3e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.248175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4223cf-5add-4a84-b20c-9745eb3c3e51 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.248471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4223cf-5add-4a84-b20c-9745eb3c3e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.248754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4223cf-5add-4a84-b20c-9745eb3c3e51 admin admin] PATH_INFO: `/v3/users/8b36880779e54979b4c28d8db11f3446` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.250710 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4223cf-5add-4a84-b20c-9745eb3c3e51 admin admin] RBAC: Authorizing `identity:get_user(user_id=8b36880779e54979b4c28d8db11f3446)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:08.252585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4223cf-5add-4a84-b20c-9745eb3c3e51 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:08.254212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 58/115] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:08 2022] GET /identity/v3/users/8b36880779e54979b4c28d8db11f3446 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:08.260698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80fadd-622e-448a-9f14-adb333e074ec admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.271218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80fadd-622e-448a-9f14-adb333e074ec admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.278314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba676bb-71b3-4d4f-b847-3322c57101da None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.278649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba676bb-71b3-4d4f-b847-3322c57101da None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.278942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba676bb-71b3-4d4f-b847-3322c57101da None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.281018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 59/116] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:08.282718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51379db-cf95-4f64-86e3-e3e00e1ba88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.283921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51379db-cf95-4f64-86e3-e3e00e1ba88d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.284430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51379db-cf95-4f64-86e3-e3e00e1ba88d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.284963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51379db-cf95-4f64-86e3-e3e00e1ba88d admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.286689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f08f2-549c-4880-95bf-e5117d28b68e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.286972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f08f2-549c-4880-95bf-e5117d28b68e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.287262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f08f2-549c-4880-95bf-e5117d28b68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.288155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51379db-cf95-4f64-86e3-e3e00e1ba88d admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:08.290562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51379db-cf95-4f64-86e3-e3e00e1ba88d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:08.293866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 58/117] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:08 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:08.299458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51379db-cf95-4f64-86e3-e3e00e1ba88d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.315022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51379db-cf95-4f64-86e3-e3e00e1ba88d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.320441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ef71-3ee2-4eb7-a763-733c14e54dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.321597 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ef71-3ee2-4eb7-a763-733c14e54dee admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.322868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ef71-3ee2-4eb7-a763-733c14e54dee admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.323706 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488ef71-3ee2-4eb7-a763-733c14e54dee admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63/users/8b36880779e54979b4c28d8db11f3446/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.324539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-7a8f08f2-549c-4880-95bf-e5117d28b68e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:08.326608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7a8f08f2-549c-4880-95bf-e5117d28b68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:08.328278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ef71-3ee2-4eb7-a763-733c14e54dee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb3d018836e4765a6346dd80809dc63, user_id=8b36880779e54979b4c28d8db11f3446, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:08.331404 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488ef71-3ee2-4eb7-a763-733c14e54dee admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:08.352129 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 59/118] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:08 2022] PUT /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63/users/8b36880779e54979b4c28d8db11f3446/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:36:08.357097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 60/119] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:08.395685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ef71-3ee2-4eb7-a763-733c14e54dee admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.472810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488ef71-3ee2-4eb7-a763-733c14e54dee admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.478069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40af02-fbd4-4213-9fdc-bc77a251be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.480228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40af02-fbd4-4213-9fdc-bc77a251be56 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.480713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40af02-fbd4-4213-9fdc-bc77a251be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.481208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40af02-fbd4-4213-9fdc-bc77a251be56 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.497028 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40af02-fbd4-4213-9fdc-bc77a251be56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:08.504534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-0d40af02-fbd4-4213-9fdc-bc77a251be56 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:08.506187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 60/120] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:08.512325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f08f2-549c-4880-95bf-e5117d28b68e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.530573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f08f2-549c-4880-95bf-e5117d28b68e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.548362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d09d7-ad85-4b56-bbed-07ef27390f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.549069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d09d7-ad85-4b56-bbed-07ef27390f64 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.549361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d09d7-ad85-4b56-bbed-07ef27390f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.549649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d09d7-ad85-4b56-bbed-07ef27390f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.550441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d09d7-ad85-4b56-bbed-07ef27390f64 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:08.550755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d09d7-ad85-4b56-bbed-07ef27390f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:08.552427 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d09d7-ad85-4b56-bbed-07ef27390f64 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:08.571082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 61/121] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:08.576781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40af02-fbd4-4213-9fdc-bc77a251be56 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.587958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40af02-fbd4-4213-9fdc-bc77a251be56 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.600762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1ce48-33dc-4255-aa7d-2039f835bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.602029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1ce48-33dc-4255-aa7d-2039f835bb48 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.602627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1ce48-33dc-4255-aa7d-2039f835bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.603126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1ce48-33dc-4255-aa7d-2039f835bb48 admin admin] PATH_INFO: `/v3/users/fe303c155a5746d58d2ffed983e1b866` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.608433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1ce48-33dc-4255-aa7d-2039f835bb48 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe303c155a5746d58d2ffed983e1b866)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:08.611052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1ce48-33dc-4255-aa7d-2039f835bb48 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:08.613012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 61/122] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:08 2022] GET /identity/v3/users/fe303c155a5746d58d2ffed983e1b866 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:08.618553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d09d7-ad85-4b56-bbed-07ef27390f64 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.632867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d09d7-ad85-4b56-bbed-07ef27390f64 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.645407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f83b1a-afbd-4a5b-97aa-b1c9858c4c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.645407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83b1a-afbd-4a5b-97aa-b1c9858c4c3f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.645407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83b1a-afbd-4a5b-97aa-b1c9858c4c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.645736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f83b1a-afbd-4a5b-97aa-b1c9858c4c3f admin admin] PATH_INFO: `/v3/projects/676050fbd0d54652b68674deada9cbd3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.648851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83b1a-afbd-4a5b-97aa-b1c9858c4c3f admin admin] RBAC: Authorizing `identity:get_project(project_id=676050fbd0d54652b68674deada9cbd3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:08.651669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f83b1a-afbd-4a5b-97aa-b1c9858c4c3f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:08.653419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 62/123] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:08 2022] GET /identity/v3/projects/676050fbd0d54652b68674deada9cbd3 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:08.659462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1ce48-33dc-4255-aa7d-2039f835bb48 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:08.670827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1ce48-33dc-4255-aa7d-2039f835bb48 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:08.683557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e49651-396f-4124-9af0-170b79f5e722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:08.684625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e49651-396f-4124-9af0-170b79f5e722 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.684913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e49651-396f-4124-9af0-170b79f5e722 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.685246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e49651-396f-4124-9af0-170b79f5e722 admin admin] PATH_INFO: `/v3/projects/676050fbd0d54652b68674deada9cbd3/users/fe303c155a5746d58d2ffed983e1b866/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.692939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e49651-396f-4124-9af0-170b79f5e722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676050fbd0d54652b68674deada9cbd3, user_id=fe303c155a5746d58d2ffed983e1b866, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:08.695820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e49651-396f-4124-9af0-170b79f5e722 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:08.715508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 62/124] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:08 2022] PUT /identity/v3/projects/676050fbd0d54652b68674deada9cbd3/users/fe303c155a5746d58d2ffed983e1b866/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:08.910528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e905b4-fc61-4078-8c5e-c58cc6f12778 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.911145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e905b4-fc61-4078-8c5e-c58cc6f12778 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.911692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e905b4-fc61-4078-8c5e-c58cc6f12778 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.913831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 63/125] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:08.920128 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5b7d1-b25d-421a-8894-815786b53068 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:08.920423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5b7d1-b25d-421a-8894-815786b53068 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:08.920697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5b7d1-b25d-421a-8894-815786b53068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:08.949216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-49a5b7d1-b25d-421a-8894-815786b53068 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:08.950448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-49a5b7d1-b25d-421a-8894-815786b53068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:09.016422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 63/126] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:09.049432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e905b4-fc61-4078-8c5e-c58cc6f12778 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:09.073658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e905b4-fc61-4078-8c5e-c58cc6f12778 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:09.083585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70254fb2-26c1-4976-89bc-dc9fd3fd68ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:09.084752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254fb2-26c1-4976-89bc-dc9fd3fd68ad admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.085254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254fb2-26c1-4976-89bc-dc9fd3fd68ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.085733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70254fb2-26c1-4976-89bc-dc9fd3fd68ad admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.087139 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70254fb2-26c1-4976-89bc-dc9fd3fd68ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:09.089332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70254fb2-26c1-4976-89bc-dc9fd3fd68ad admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:09.091139 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 64/127] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:09.096768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5b7d1-b25d-421a-8894-815786b53068 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:09.110859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5b7d1-b25d-421a-8894-815786b53068 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:09.119714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50e249-6809-40e3-9e1c-7508e6541752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:09.120449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50e249-6809-40e3-9e1c-7508e6541752 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.120785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50e249-6809-40e3-9e1c-7508e6541752 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.121068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50e249-6809-40e3-9e1c-7508e6541752 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.121807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50e249-6809-40e3-9e1c-7508e6541752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:09.123927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50e249-6809-40e3-9e1c-7508e6541752 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:09.169227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 64/128] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:36:09 2022] POST /identity/v3/projects => generated 302 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:09.591610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a334-3344-4fb5-97cb-6678148f9841 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.592594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a334-3344-4fb5-97cb-6678148f9841 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.593084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a334-3344-4fb5-97cb-6678148f9841 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.595179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 65/129] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:09.601024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494ca2-ad68-4141-9124-78cf6d59c40a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.601593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494ca2-ad68-4141-9124-78cf6d59c40a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.602076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494ca2-ad68-4141-9124-78cf6d59c40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.624760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ba494ca2-ad68-4141-9124-78cf6d59c40a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:09.626296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ba494ca2-ad68-4141-9124-78cf6d59c40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:09.698684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 65/130] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:09.744789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a334-3344-4fb5-97cb-6678148f9841 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:09.761967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a334-3344-4fb5-97cb-6678148f9841 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:09.766786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13874ff3-61e3-476b-82ff-fcf6ba7d5da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:09.767873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13874ff3-61e3-476b-82ff-fcf6ba7d5da0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.768364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13874ff3-61e3-476b-82ff-fcf6ba7d5da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.768844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13874ff3-61e3-476b-82ff-fcf6ba7d5da0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.784431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13874ff3-61e3-476b-82ff-fcf6ba7d5da0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:09.792306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-13874ff3-61e3-476b-82ff-fcf6ba7d5da0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 27 16:36:09.793752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 66/131] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:09.799623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494ca2-ad68-4141-9124-78cf6d59c40a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:09.809670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494ca2-ad68-4141-9124-78cf6d59c40a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:09.819629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280644cd-e821-47f9-b1c3-6a8dabf362f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:09.820553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280644cd-e821-47f9-b1c3-6a8dabf362f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.821065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280644cd-e821-47f9-b1c3-6a8dabf362f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.821544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280644cd-e821-47f9-b1c3-6a8dabf362f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.822599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280644cd-e821-47f9-b1c3-6a8dabf362f6 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:09.823113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280644cd-e821-47f9-b1c3-6a8dabf362f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:09.825083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280644cd-e821-47f9-b1c3-6a8dabf362f6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:09.838901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 66/132] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:09.844482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13874ff3-61e3-476b-82ff-fcf6ba7d5da0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:09.855880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13874ff3-61e3-476b-82ff-fcf6ba7d5da0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:09.864223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c2231-127c-4ddb-a6a0-dbc236fe08f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:09.865348 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c2231-127c-4ddb-a6a0-dbc236fe08f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.865865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c2231-127c-4ddb-a6a0-dbc236fe08f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.866496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c2231-127c-4ddb-a6a0-dbc236fe08f8 admin admin] PATH_INFO: `/v3/users/d6c4d47cd5644378b3f6d00c16ac8017` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.881177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c2231-127c-4ddb-a6a0-dbc236fe08f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6c4d47cd5644378b3f6d00c16ac8017)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:09.883690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c2231-127c-4ddb-a6a0-dbc236fe08f8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:09.885749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 67/133] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:09 2022] GET /identity/v3/users/d6c4d47cd5644378b3f6d00c16ac8017 => generated 289 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:09.891281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280644cd-e821-47f9-b1c3-6a8dabf362f6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:09.904801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280644cd-e821-47f9-b1c3-6a8dabf362f6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:09.912183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094f0a-6c0c-4a16-8420-5f2271b09888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:09.913207 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094f0a-6c0c-4a16-8420-5f2271b09888 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.913703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094f0a-6c0c-4a16-8420-5f2271b09888 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.914202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05094f0a-6c0c-4a16-8420-5f2271b09888 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.923394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094f0a-6c0c-4a16-8420-5f2271b09888 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:09.925427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05094f0a-6c0c-4a16-8420-5f2271b09888 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:09.937592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 67/134] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:09.943196 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c2231-127c-4ddb-a6a0-dbc236fe08f8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:09.953502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c2231-127c-4ddb-a6a0-dbc236fe08f8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:09.963989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1cc54-1639-4191-b434-b570a795067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:09.965129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1cc54-1639-4191-b434-b570a795067c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.965617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1cc54-1639-4191-b434-b570a795067c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.966096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1cc54-1639-4191-b434-b570a795067c admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.967555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1cc54-1639-4191-b434-b570a795067c admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:09.969864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1cc54-1639-4191-b434-b570a795067c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:09.971777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 68/135] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:09 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:09.977754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094f0a-6c0c-4a16-8420-5f2271b09888 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:09.987827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05094f0a-6c0c-4a16-8420-5f2271b09888 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:09.996470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47bd2a-5cf8-4a31-bd35-f564bbf84956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:09.997391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47bd2a-5cf8-4a31-bd35-f564bbf84956 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:09.997889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47bd2a-5cf8-4a31-bd35-f564bbf84956 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:09.998373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47bd2a-5cf8-4a31-bd35-f564bbf84956 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:09.999420 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47bd2a-5cf8-4a31-bd35-f564bbf84956 admin admin] RBAC: Adding query filter params (role.id=95dbcc27f28a4639b5489fe8b030cba3, scope.project.id=9fb3d018836e4765a6346dd80809dc63, user.id=d6c4d47cd5644378b3f6d00c16ac8017) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:09.999975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47bd2a-5cf8-4a31-bd35-f564bbf84956 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:10.002061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47bd2a-5cf8-4a31-bd35-f564bbf84956 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:10.012390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 68/136] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:09 2022] GET /identity/v3/role_assignments?user.id=d6c4d47cd5644378b3f6d00c16ac8017&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=95dbcc27f28a4639b5489fe8b030cba3 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:11.011431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbeb705-eaf6-428c-9f81-1d4b1739a0eb None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.012597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbeb705-eaf6-428c-9f81-1d4b1739a0eb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.013093 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbeb705-eaf6-428c-9f81-1d4b1739a0eb None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.015083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 69/137] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:11.020361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f2427-ab15-40ae-b803-e5964b0793e9 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.021180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f2427-ab15-40ae-b803-e5964b0793e9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.021685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f2427-ab15-40ae-b803-e5964b0793e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.044573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-4f2f2427-ab15-40ae-b803-e5964b0793e9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:11.046153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4f2f2427-ab15-40ae-b803-e5964b0793e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:11.055508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 69/138] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:11.091607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbeb705-eaf6-428c-9f81-1d4b1739a0eb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.105737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbeb705-eaf6-428c-9f81-1d4b1739a0eb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.116467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1758ce4-4f18-43a4-8f41-3a61806528cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.117313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1758ce4-4f18-43a4-8f41-3a61806528cd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.117595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1758ce4-4f18-43a4-8f41-3a61806528cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.117873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1758ce4-4f18-43a4-8f41-3a61806528cd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.132001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1758ce4-4f18-43a4-8f41-3a61806528cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:11.139134 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-f1758ce4-4f18-43a4-8f41-3a61806528cd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:11.140382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 70/139] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:11.146068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f2427-ab15-40ae-b803-e5964b0793e9 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.160685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f2427-ab15-40ae-b803-e5964b0793e9 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.172218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc307fe-11db-45ab-af16-ec57566ade40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.173286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc307fe-11db-45ab-af16-ec57566ade40 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.173779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc307fe-11db-45ab-af16-ec57566ade40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.174307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc307fe-11db-45ab-af16-ec57566ade40 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.175313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc307fe-11db-45ab-af16-ec57566ade40 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:11.175892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc307fe-11db-45ab-af16-ec57566ade40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.177779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc307fe-11db-45ab-af16-ec57566ade40 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.192133 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 70/140] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:11.197282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1758ce4-4f18-43a4-8f41-3a61806528cd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.213668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1758ce4-4f18-43a4-8f41-3a61806528cd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.218370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bd80f-1057-4aa6-99a2-af133b4dacde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.219232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bd80f-1057-4aa6-99a2-af133b4dacde admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.219515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bd80f-1057-4aa6-99a2-af133b4dacde admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.219827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bd80f-1057-4aa6-99a2-af133b4dacde admin admin] PATH_INFO: `/v3/users/fe303c155a5746d58d2ffed983e1b866` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.224323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bd80f-1057-4aa6-99a2-af133b4dacde admin admin] RBAC: Authorizing `identity:get_user(user_id=fe303c155a5746d58d2ffed983e1b866)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.226594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bd80f-1057-4aa6-99a2-af133b4dacde admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.228416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 71/141] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/users/fe303c155a5746d58d2ffed983e1b866 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:11.234522 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc307fe-11db-45ab-af16-ec57566ade40 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.249559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc307fe-11db-45ab-af16-ec57566ade40 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.259838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093feae-7cac-41df-9d22-d9b697863c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.260847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093feae-7cac-41df-9d22-d9b697863c1c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.261342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093feae-7cac-41df-9d22-d9b697863c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.261888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093feae-7cac-41df-9d22-d9b697863c1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.272077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093feae-7cac-41df-9d22-d9b697863c1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.273914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093feae-7cac-41df-9d22-d9b697863c1c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.283789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 71/142] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:11.289268 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bd80f-1057-4aa6-99a2-af133b4dacde admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.304564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bd80f-1057-4aa6-99a2-af133b4dacde admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.315307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc7ccd-e0e7-4b32-afb7-766db372dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.316207 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc7ccd-e0e7-4b32-afb7-766db372dd1b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.316491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc7ccd-e0e7-4b32-afb7-766db372dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.316766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc7ccd-e0e7-4b32-afb7-766db372dd1b admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.320298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc7ccd-e0e7-4b32-afb7-766db372dd1b admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.323043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc7ccd-e0e7-4b32-afb7-766db372dd1b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.324846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 72/143] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:11.331154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093feae-7cac-41df-9d22-d9b697863c1c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.345310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093feae-7cac-41df-9d22-d9b697863c1c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.351183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0e8d2-ecbe-4e1f-a045-ebfc58eac53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.352008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e8d2-ecbe-4e1f-a045-ebfc58eac53d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.352347 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e8d2-ecbe-4e1f-a045-ebfc58eac53d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.352632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0e8d2-ecbe-4e1f-a045-ebfc58eac53d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.354076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0e8d2-ecbe-4e1f-a045-ebfc58eac53d admin admin] RBAC: Adding query filter params (role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=9fb3d018836e4765a6346dd80809dc63, user.id=fe303c155a5746d58d2ffed983e1b866) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:11.354398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0e8d2-ecbe-4e1f-a045-ebfc58eac53d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.356408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0e8d2-ecbe-4e1f-a045-ebfc58eac53d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.363172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 72/144] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/role_assignments?user.id=fe303c155a5746d58d2ffed983e1b866&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:11.558296 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911c52e-adec-403a-93f9-457a0ad44937 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.558672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911c52e-adec-403a-93f9-457a0ad44937 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.558855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911c52e-adec-403a-93f9-457a0ad44937 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.561188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 73/145] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:11.570663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b678a5-f5e9-4141-ab1c-2987ec92f406 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.570943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b678a5-f5e9-4141-ab1c-2987ec92f406 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.571236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b678a5-f5e9-4141-ab1c-2987ec92f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.592447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-44b678a5-f5e9-4141-ab1c-2987ec92f406 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:11.593645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-44b678a5-f5e9-4141-ab1c-2987ec92f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:11.604197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cff27-b099-43d6-ada3-dd442c578cdd None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.604609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cff27-b099-43d6-ada3-dd442c578cdd None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.604880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19cff27-b099-43d6-ada3-dd442c578cdd None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.606837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 74/146] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:11.614637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a513-034c-4362-acd9-70a512388c95 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.614992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a513-034c-4362-acd9-70a512388c95 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.615233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0a513-034c-4362-acd9-70a512388c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.621227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 73/147] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:11.642310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1be0a513-034c-4362-acd9-70a512388c95 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:11.643532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1be0a513-034c-4362-acd9-70a512388c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:11.656813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 75/148] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:11.672402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b678a5-f5e9-4141-ab1c-2987ec92f406 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.683095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b678a5-f5e9-4141-ab1c-2987ec92f406 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.691788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b85c7-be05-4fc5-8694-ef3a7f323198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.692622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b85c7-be05-4fc5-8694-ef3a7f323198 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.692906 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b85c7-be05-4fc5-8694-ef3a7f323198 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.693183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b85c7-be05-4fc5-8694-ef3a7f323198 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.702916 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a513-034c-4362-acd9-70a512388c95 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.711809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0a513-034c-4362-acd9-70a512388c95 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.722552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef60c3f-ae75-4537-b8fd-7f00065bcc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.723355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef60c3f-ae75-4537-b8fd-7f00065bcc7a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.723663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef60c3f-ae75-4537-b8fd-7f00065bcc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.723933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef60c3f-ae75-4537-b8fd-7f00065bcc7a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.729319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b85c7-be05-4fc5-8694-ef3a7f323198 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:11.740498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-254b85c7-be05-4fc5-8694-ef3a7f323198 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:11.747420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef60c3f-ae75-4537-b8fd-7f00065bcc7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:11.754244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-5ef60c3f-ae75-4537-b8fd-7f00065bcc7a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:11.755620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 76/149] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:11.756197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef60c3f-ae75-4537-b8fd-7f00065bcc7a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.756787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 74/150] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:11.764810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b85c7-be05-4fc5-8694-ef3a7f323198 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.774125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef60c3f-ae75-4537-b8fd-7f00065bcc7a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.777468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b85c7-be05-4fc5-8694-ef3a7f323198 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.783600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ae7e5-74d7-4199-b58f-ec4ae94df1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.784261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ae7e5-74d7-4199-b58f-ec4ae94df1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.784547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ae7e5-74d7-4199-b58f-ec4ae94df1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.784828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ae7e5-74d7-4199-b58f-ec4ae94df1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.785592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ae7e5-74d7-4199-b58f-ec4ae94df1b9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:11.785902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ae7e5-74d7-4199-b58f-ec4ae94df1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.787519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ae7e5-74d7-4199-b58f-ec4ae94df1b9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.790637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705163e-4cf5-4fe0-a3a5-dc4f35554080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.791875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705163e-4cf5-4fe0-a3a5-dc4f35554080 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.792234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705163e-4cf5-4fe0-a3a5-dc4f35554080 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.792453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705163e-4cf5-4fe0-a3a5-dc4f35554080 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.793176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705163e-4cf5-4fe0-a3a5-dc4f35554080 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:11.793481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705163e-4cf5-4fe0-a3a5-dc4f35554080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.795085 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3705163e-4cf5-4fe0-a3a5-dc4f35554080 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.808656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 77/151] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:11.810432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 75/152] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:11.818288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705163e-4cf5-4fe0-a3a5-dc4f35554080 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.824273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ae7e5-74d7-4199-b58f-ec4ae94df1b9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.835304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705163e-4cf5-4fe0-a3a5-dc4f35554080 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.840559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ae7e5-74d7-4199-b58f-ec4ae94df1b9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.845714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a355-7e24-4caa-87b5-823ca154e056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.847515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a355-7e24-4caa-87b5-823ca154e056 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.847838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a355-7e24-4caa-87b5-823ca154e056 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.848105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7a355-7e24-4caa-87b5-823ca154e056 admin admin] PATH_INFO: `/v3/users/fe303c155a5746d58d2ffed983e1b866` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.849613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7a355-7e24-4caa-87b5-823ca154e056 admin admin] RBAC: Authorizing `identity:get_user(user_id=fe303c155a5746d58d2ffed983e1b866)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.851785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7a355-7e24-4caa-87b5-823ca154e056 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.855327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c4a4e-2783-4bb5-afb3-17133f5ff28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.856245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c4a4e-2783-4bb5-afb3-17133f5ff28e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.856518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c4a4e-2783-4bb5-afb3-17133f5ff28e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.856792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c4a4e-2783-4bb5-afb3-17133f5ff28e admin admin] PATH_INFO: `/v3/users/8b36880779e54979b4c28d8db11f3446` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.858027 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c4a4e-2783-4bb5-afb3-17133f5ff28e admin admin] RBAC: Authorizing `identity:get_user(user_id=8b36880779e54979b4c28d8db11f3446)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.859804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 78/153] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/users/fe303c155a5746d58d2ffed983e1b866 => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:11.860061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c4a4e-2783-4bb5-afb3-17133f5ff28e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.861672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 76/154] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/users/8b36880779e54979b4c28d8db11f3446 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:11.872287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a355-7e24-4caa-87b5-823ca154e056 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.875279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c4a4e-2783-4bb5-afb3-17133f5ff28e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.894413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7a355-7e24-4caa-87b5-823ca154e056 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.899147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c4a4e-2783-4bb5-afb3-17133f5ff28e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.911337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84b98-ec37-40cd-acae-b905c22f47a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.912487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84b98-ec37-40cd-acae-b905c22f47a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.912993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84b98-ec37-40cd-acae-b905c22f47a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.913494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f84b98-ec37-40cd-acae-b905c22f47a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.917232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadfb40-dca2-4dd8-a6e9-0a2a5adf5955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.918323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadfb40-dca2-4dd8-a6e9-0a2a5adf5955 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.918848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadfb40-dca2-4dd8-a6e9-0a2a5adf5955 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.919365 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadfb40-dca2-4dd8-a6e9-0a2a5adf5955 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:11.939323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84b98-ec37-40cd-acae-b905c22f47a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.941137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f84b98-ec37-40cd-acae-b905c22f47a2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.951142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadfb40-dca2-4dd8-a6e9-0a2a5adf5955 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:11.952947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadfb40-dca2-4dd8-a6e9-0a2a5adf5955 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:11.959728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 79/155] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:36:11.967909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84b98-ec37-40cd-acae-b905c22f47a2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.976626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 77/156] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:36:11.981289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f84b98-ec37-40cd-acae-b905c22f47a2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.984970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadfb40-dca2-4dd8-a6e9-0a2a5adf5955 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:11.995892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadfb40-dca2-4dd8-a6e9-0a2a5adf5955 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:11.997623 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b357ce-8f99-4397-9427-3bcce26050d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:11.998486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b357ce-8f99-4397-9427-3bcce26050d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:11.998763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b357ce-8f99-4397-9427-3bcce26050d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:11.999032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b357ce-8f99-4397-9427-3bcce26050d9 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.000250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b357ce-8f99-4397-9427-3bcce26050d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.002440 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b357ce-8f99-4397-9427-3bcce26050d9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.005617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 80/157] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:12.006434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bfce5-c08c-48c8-a72d-c312a6339112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.007550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bfce5-c08c-48c8-a72d-c312a6339112 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.008071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bfce5-c08c-48c8-a72d-c312a6339112 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.008576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bfce5-c08c-48c8-a72d-c312a6339112 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.010622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bfce5-c08c-48c8-a72d-c312a6339112 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.013105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8bfce5-c08c-48c8-a72d-c312a6339112 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.014991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 78/158] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:11 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:12.016018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b357ce-8f99-4397-9427-3bcce26050d9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.023902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bfce5-c08c-48c8-a72d-c312a6339112 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.032517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b357ce-8f99-4397-9427-3bcce26050d9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.037287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e3569-0505-4913-9356-419e77b6241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.038210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e3569-0505-4913-9356-419e77b6241a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.038667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e3569-0505-4913-9356-419e77b6241a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.039114 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e3569-0505-4913-9356-419e77b6241a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.040190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e3569-0505-4913-9356-419e77b6241a admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=9fb3d018836e4765a6346dd80809dc63, user.id=8b36880779e54979b4c28d8db11f3446) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:12.040696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e3569-0505-4913-9356-419e77b6241a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.043763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e3569-0505-4913-9356-419e77b6241a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.044810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8bfce5-c08c-48c8-a72d-c312a6339112 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.060560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 81/159] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:12 2022] GET /identity/v3/role_assignments?user.id=8b36880779e54979b4c28d8db11f3446&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:12.060877 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992125aa-432e-486e-b6c1-6ee6773fd580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.061796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992125aa-432e-486e-b6c1-6ee6773fd580 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.062290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992125aa-432e-486e-b6c1-6ee6773fd580 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.062845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992125aa-432e-486e-b6c1-6ee6773fd580 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.064582 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992125aa-432e-486e-b6c1-6ee6773fd580 admin admin] RBAC: Adding query filter params (role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=9fb3d018836e4765a6346dd80809dc63, user.id=fe303c155a5746d58d2ffed983e1b866) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:12.065213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992125aa-432e-486e-b6c1-6ee6773fd580 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.069872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992125aa-432e-486e-b6c1-6ee6773fd580 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.081605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 79/160] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:12 2022] GET /identity/v3/role_assignments?user.id=fe303c155a5746d58d2ffed983e1b866&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 608 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:12.111996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f82c2-e66c-417d-9018-d350b518a1ef None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.112479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f82c2-e66c-417d-9018-d350b518a1ef None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.112951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435f82c2-e66c-417d-9018-d350b518a1ef None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.116718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 82/161] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:12.134462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d4ecd-8037-419f-b258-7ef10b243dc2 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.134934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d4ecd-8037-419f-b258-7ef10b243dc2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.135374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d4ecd-8037-419f-b258-7ef10b243dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.172100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-965d4ecd-8037-419f-b258-7ef10b243dc2 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:12.173920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-965d4ecd-8037-419f-b258-7ef10b243dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:12.190559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 80/162] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:12.232319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f82c2-e66c-417d-9018-d350b518a1ef None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.266234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435f82c2-e66c-417d-9018-d350b518a1ef None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.277412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea578c-9efa-406f-a560-3fd560bb0dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.278802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea578c-9efa-406f-a560-3fd560bb0dbe admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.279297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea578c-9efa-406f-a560-3fd560bb0dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.280061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea578c-9efa-406f-a560-3fd560bb0dbe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.306125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea578c-9efa-406f-a560-3fd560bb0dbe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:12.317858 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-dbea578c-9efa-406f-a560-3fd560bb0dbe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:12.319535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 83/163] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:12.327085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d4ecd-8037-419f-b258-7ef10b243dc2 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.346703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d4ecd-8037-419f-b258-7ef10b243dc2 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.367255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1e922-3198-4fde-b4f5-0220e36424eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.368430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1e922-3198-4fde-b4f5-0220e36424eb admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.368920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1e922-3198-4fde-b4f5-0220e36424eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.369442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1e922-3198-4fde-b4f5-0220e36424eb admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.370995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1e922-3198-4fde-b4f5-0220e36424eb admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:12.371618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1e922-3198-4fde-b4f5-0220e36424eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.374579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1e922-3198-4fde-b4f5-0220e36424eb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.397431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 81/164] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:12.407862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea578c-9efa-406f-a560-3fd560bb0dbe admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.422159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea578c-9efa-406f-a560-3fd560bb0dbe admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.430051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886d047-6982-4eeb-8bc5-dba1a2d0801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.432456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886d047-6982-4eeb-8bc5-dba1a2d0801a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.433244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886d047-6982-4eeb-8bc5-dba1a2d0801a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.434018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886d047-6982-4eeb-8bc5-dba1a2d0801a admin admin] PATH_INFO: `/v3/users/fe303c155a5746d58d2ffed983e1b866` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.436510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886d047-6982-4eeb-8bc5-dba1a2d0801a admin admin] RBAC: Authorizing `identity:get_user(user_id=fe303c155a5746d58d2ffed983e1b866)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.440334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886d047-6982-4eeb-8bc5-dba1a2d0801a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.447216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 84/165] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:12 2022] GET /identity/v3/users/fe303c155a5746d58d2ffed983e1b866 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:12.450091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1e922-3198-4fde-b4f5-0220e36424eb admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.473228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1e922-3198-4fde-b4f5-0220e36424eb admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.485708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d56c4-bfa0-4820-a4a8-e90fca738ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.486878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d56c4-bfa0-4820-a4a8-e90fca738ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.487433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d56c4-bfa0-4820-a4a8-e90fca738ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.487988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d56c4-bfa0-4820-a4a8-e90fca738ba6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.503972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d56c4-bfa0-4820-a4a8-e90fca738ba6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.507286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d56c4-bfa0-4820-a4a8-e90fca738ba6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.525410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 82/166] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:12.531913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886d047-6982-4eeb-8bc5-dba1a2d0801a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.545949 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886d047-6982-4eeb-8bc5-dba1a2d0801a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.550785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b9b0f-5915-43d8-8c93-74b01f59f837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.551506 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9b0f-5915-43d8-8c93-74b01f59f837 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.551872 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9b0f-5915-43d8-8c93-74b01f59f837 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.552122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b9b0f-5915-43d8-8c93-74b01f59f837 admin admin] PATH_INFO: `/v3/projects/676050fbd0d54652b68674deada9cbd3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.554182 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b9b0f-5915-43d8-8c93-74b01f59f837 admin admin] RBAC: Authorizing `identity:get_project(project_id=676050fbd0d54652b68674deada9cbd3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.556553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b9b0f-5915-43d8-8c93-74b01f59f837 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.558238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 85/167] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:12 2022] GET /identity/v3/projects/676050fbd0d54652b68674deada9cbd3 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:12.565089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d56c4-bfa0-4820-a4a8-e90fca738ba6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.580930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d56c4-bfa0-4820-a4a8-e90fca738ba6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.589961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867be900-73fb-4c2d-97c5-cfb9878a3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.591077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867be900-73fb-4c2d-97c5-cfb9878a3364 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.591560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867be900-73fb-4c2d-97c5-cfb9878a3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.592074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867be900-73fb-4c2d-97c5-cfb9878a3364 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.593601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867be900-73fb-4c2d-97c5-cfb9878a3364 admin admin] RBAC: Adding query filter params (role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=676050fbd0d54652b68674deada9cbd3, user.id=fe303c155a5746d58d2ffed983e1b866) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:12.594183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867be900-73fb-4c2d-97c5-cfb9878a3364 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.596398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867be900-73fb-4c2d-97c5-cfb9878a3364 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.602892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 83/168] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:12 2022] GET /identity/v3/role_assignments?user.id=fe303c155a5746d58d2ffed983e1b866&scope.project.id=676050fbd0d54652b68674deada9cbd3&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:12.756206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a14557-d87a-4f3c-9a36-826ac6cf1740 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.756570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a14557-d87a-4f3c-9a36-826ac6cf1740 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.756778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a14557-d87a-4f3c-9a36-826ac6cf1740 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.758710 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 86/169] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:12.764821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea21b6-362b-47c1-aac0-0101323048b0 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.765114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea21b6-362b-47c1-aac0-0101323048b0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.765444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea21b6-362b-47c1-aac0-0101323048b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.784376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-13ea21b6-362b-47c1-aac0-0101323048b0 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:12.785552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-13ea21b6-362b-47c1-aac0-0101323048b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:12.793635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 84/170] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:12.817737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a14557-d87a-4f3c-9a36-826ac6cf1740 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.832354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a14557-d87a-4f3c-9a36-826ac6cf1740 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.837749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404db6a9-4256-461a-94e5-0b4ba527ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.838362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404db6a9-4256-461a-94e5-0b4ba527ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.838643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404db6a9-4256-461a-94e5-0b4ba527ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.838915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404db6a9-4256-461a-94e5-0b4ba527ba7a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.840202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404db6a9-4256-461a-94e5-0b4ba527ba7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.841907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404db6a9-4256-461a-94e5-0b4ba527ba7a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.843512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 87/171] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:12.849265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea21b6-362b-47c1-aac0-0101323048b0 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:12.858675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea21b6-362b-47c1-aac0-0101323048b0 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:12.863227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa461a-0a73-4d08-977f-4d4c725d1e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:12.863965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa461a-0a73-4d08-977f-4d4c725d1e09 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:12.864256 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa461a-0a73-4d08-977f-4d4c725d1e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:12.864541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa461a-0a73-4d08-977f-4d4c725d1e09 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:12.865268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa461a-0a73-4d08-977f-4d4c725d1e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:12.867344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa461a-0a73-4d08-977f-4d4c725d1e09 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:12.886833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 85/172] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:12 2022] POST /identity/v3/users => generated 283 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:13.453121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0abb-2dd9-44f9-b1cf-95a532cc1da6 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:13.453628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0abb-2dd9-44f9-b1cf-95a532cc1da6 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:13.453730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccb0abb-2dd9-44f9-b1cf-95a532cc1da6 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:13.455619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 88/173] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:13.461011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ab8b1-7ee5-4467-8996-4de3ddd3a302 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:13.461401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ab8b1-7ee5-4467-8996-4de3ddd3a302 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:13.461562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ab8b1-7ee5-4467-8996-4de3ddd3a302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:13.480177 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-c45ab8b1-7ee5-4467-8996-4de3ddd3a302 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:13.481363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c45ab8b1-7ee5-4467-8996-4de3ddd3a302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:13.489312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 86/174] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:13.512770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0abb-2dd9-44f9-b1cf-95a532cc1da6 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:13.525220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccb0abb-2dd9-44f9-b1cf-95a532cc1da6 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:13.530466 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936e899-a7c5-48b7-aff9-75e4d92ba4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:13.531477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936e899-a7c5-48b7-aff9-75e4d92ba4bc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:13.531980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936e899-a7c5-48b7-aff9-75e4d92ba4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:13.532441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936e899-a7c5-48b7-aff9-75e4d92ba4bc admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:13.543913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5936e899-a7c5-48b7-aff9-75e4d92ba4bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:13.551241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-5936e899-a7c5-48b7-aff9-75e4d92ba4bc admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 27 16:36:13.557668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 89/175] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:13.559210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ab8b1-7ee5-4467-8996-4de3ddd3a302 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:13.568392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ab8b1-7ee5-4467-8996-4de3ddd3a302 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:13.573854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56606b-63f0-4600-a73d-bef5b84922dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:13.574740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56606b-63f0-4600-a73d-bef5b84922dd admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:13.575213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56606b-63f0-4600-a73d-bef5b84922dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:13.575725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56606b-63f0-4600-a73d-bef5b84922dd admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:13.576679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56606b-63f0-4600-a73d-bef5b84922dd admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:13.577193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56606b-63f0-4600-a73d-bef5b84922dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:13.579057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56606b-63f0-4600-a73d-bef5b84922dd admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:13.587643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 87/176] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:13.597008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936e899-a7c5-48b7-aff9-75e4d92ba4bc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:13.608453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936e899-a7c5-48b7-aff9-75e4d92ba4bc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:13.613046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2200b-c68d-4adf-bf62-ec929ba78406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:13.614181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2200b-c68d-4adf-bf62-ec929ba78406 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:13.614654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2200b-c68d-4adf-bf62-ec929ba78406 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:13.615121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2200b-c68d-4adf-bf62-ec929ba78406 admin admin] PATH_INFO: `/v3/users/d6c4d47cd5644378b3f6d00c16ac8017` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:13.616563 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2200b-c68d-4adf-bf62-ec929ba78406 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6c4d47cd5644378b3f6d00c16ac8017)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:13.618891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2200b-c68d-4adf-bf62-ec929ba78406 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:13.621183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 90/177] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:13 2022] GET /identity/v3/users/d6c4d47cd5644378b3f6d00c16ac8017 => generated 289 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:13.628968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56606b-63f0-4600-a73d-bef5b84922dd admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:13.639712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56606b-63f0-4600-a73d-bef5b84922dd admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:13.644408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14859b12-1ca4-4798-ade4-e857310e965e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:13.645542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14859b12-1ca4-4798-ade4-e857310e965e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:13.646062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14859b12-1ca4-4798-ade4-e857310e965e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:13.646528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14859b12-1ca4-4798-ade4-e857310e965e admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:13.648018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14859b12-1ca4-4798-ade4-e857310e965e admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:13.650418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14859b12-1ca4-4798-ade4-e857310e965e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:13.652834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 88/178] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:13 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:13.658974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2200b-c68d-4adf-bf62-ec929ba78406 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:13.670119 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2200b-c68d-4adf-bf62-ec929ba78406 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:13.674842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45557db-e78a-4554-9731-f8e90848172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:13.676009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45557db-e78a-4554-9731-f8e90848172b admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:13.676513 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45557db-e78a-4554-9731-f8e90848172b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:13.677037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45557db-e78a-4554-9731-f8e90848172b admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63/users/d6c4d47cd5644378b3f6d00c16ac8017/roles/95dbcc27f28a4639b5489fe8b030cba3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:13.679226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45557db-e78a-4554-9731-f8e90848172b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb3d018836e4765a6346dd80809dc63, user_id=d6c4d47cd5644378b3f6d00c16ac8017, role_id=95dbcc27f28a4639b5489fe8b030cba3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:13.682590 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45557db-e78a-4554-9731-f8e90848172b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:13.698157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 91/179] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:13 2022] PUT /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63/users/d6c4d47cd5644378b3f6d00c16ac8017/roles/95dbcc27f28a4639b5489fe8b030cba3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:36:15.260746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea770b2-000f-424e-8d08-1ba70ecb5c4e None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.261502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea770b2-000f-424e-8d08-1ba70ecb5c4e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.261502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea770b2-000f-424e-8d08-1ba70ecb5c4e None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.263089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 89/180] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:15.268562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df993a-9aed-4d3f-b136-85369ccc7a09 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.268971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df993a-9aed-4d3f-b136-85369ccc7a09 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.269137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df993a-9aed-4d3f-b136-85369ccc7a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.287610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a4df993a-9aed-4d3f-b136-85369ccc7a09 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:15.288806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a4df993a-9aed-4d3f-b136-85369ccc7a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:15.347920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 92/181] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:15.373031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea770b2-000f-424e-8d08-1ba70ecb5c4e None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.373990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3b8b9-5793-4fcf-9ba0-108488f8e4d2 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.374287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3b8b9-5793-4fcf-9ba0-108488f8e4d2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.374570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d3b8b9-5793-4fcf-9ba0-108488f8e4d2 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.376611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 93/182] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:15.381674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff56464-7023-40ee-a1f3-efb9ff5b7099 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.381965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff56464-7023-40ee-a1f3-efb9ff5b7099 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.382362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff56464-7023-40ee-a1f3-efb9ff5b7099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.386062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea770b2-000f-424e-8d08-1ba70ecb5c4e None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.390573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a89de-b539-4bd1-bc62-8ac82b7a95fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.391361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a89de-b539-4bd1-bc62-8ac82b7a95fa admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.391673 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a89de-b539-4bd1-bc62-8ac82b7a95fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.391956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a89de-b539-4bd1-bc62-8ac82b7a95fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.399870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-3ff56464-7023-40ee-a1f3-efb9ff5b7099 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:15.401601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3ff56464-7023-40ee-a1f3-efb9ff5b7099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:15.403263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a89de-b539-4bd1-bc62-8ac82b7a95fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:15.409585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 94/183] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:15.411407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-729a89de-b539-4bd1-bc62-8ac82b7a95fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:15.412646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 90/184] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:15.419027 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff56464-7023-40ee-a1f3-efb9ff5b7099 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.428368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff56464-7023-40ee-a1f3-efb9ff5b7099 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.432944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba4343-ca97-469d-b5c7-3662b2d1277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.433618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba4343-ca97-469d-b5c7-3662b2d1277b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.433974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba4343-ca97-469d-b5c7-3662b2d1277b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.434260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba4343-ca97-469d-b5c7-3662b2d1277b admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.435034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba4343-ca97-469d-b5c7-3662b2d1277b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:15.435342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba4343-ca97-469d-b5c7-3662b2d1277b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.435665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053690-0d19-4947-a61a-2937ae601749 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.435960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053690-0d19-4947-a61a-2937ae601749 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.436244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053690-0d19-4947-a61a-2937ae601749 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.437024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba4343-ca97-469d-b5c7-3662b2d1277b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.438984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 91/185] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:15.439627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053690-0d19-4947-a61a-2937ae601749 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.446274 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 95/186] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:15.447367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038328c-0555-44e6-a146-6504100fd421 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.447873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038328c-0555-44e6-a146-6504100fd421 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.448266 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038328c-0555-44e6-a146-6504100fd421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.456797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053690-0d19-4947-a61a-2937ae601749 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.461351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48af94-5b1e-408b-a02e-333648b6b4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.462152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48af94-5b1e-408b-a02e-333648b6b4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.462433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48af94-5b1e-408b-a02e-333648b6b4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.462709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48af94-5b1e-408b-a02e-333648b6b4b7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.466083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6038328c-0555-44e6-a146-6504100fd421 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:15.467269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6038328c-0555-44e6-a146-6504100fd421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:15.473823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48af94-5b1e-408b-a02e-333648b6b4b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:15.479679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 96/187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:15.479679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038328c-0555-44e6-a146-6504100fd421 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.481720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-cc48af94-5b1e-408b-a02e-333648b6b4b7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:15.483147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 92/188] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:15.489127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038328c-0555-44e6-a146-6504100fd421 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.492498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48af94-5b1e-408b-a02e-333648b6b4b7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.493719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cda93-432c-440d-ae2c-09b540dd6244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.494755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cda93-432c-440d-ae2c-09b540dd6244 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.497503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cda93-432c-440d-ae2c-09b540dd6244 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.497503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cda93-432c-440d-ae2c-09b540dd6244 admin admin] PATH_INFO: `/v3/users/9466ecd7b48f473a9b58998803276fb9` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.507654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48af94-5b1e-408b-a02e-333648b6b4b7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.512067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cda93-432c-440d-ae2c-09b540dd6244 admin admin] RBAC: Authorizing `identity:get_user(user_id=9466ecd7b48f473a9b58998803276fb9)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.513714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75049636-e6b5-443d-bcc8-34123242b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.514205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cda93-432c-440d-ae2c-09b540dd6244 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.514384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75049636-e6b5-443d-bcc8-34123242b8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.514675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75049636-e6b5-443d-bcc8-34123242b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.514954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75049636-e6b5-443d-bcc8-34123242b8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.515753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75049636-e6b5-443d-bcc8-34123242b8e4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:15.516001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 97/189] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/users/9466ecd7b48f473a9b58998803276fb9 => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:15.518369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75049636-e6b5-443d-bcc8-34123242b8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.518480 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cda93-432c-440d-ae2c-09b540dd6244 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.518551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75049636-e6b5-443d-bcc8-34123242b8e4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.528263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 93/190] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:15.528508 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cda93-432c-440d-ae2c-09b540dd6244 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.529682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75049636-e6b5-443d-bcc8-34123242b8e4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.536156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7170d9c-168d-4865-a3eb-86d2dbd448bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.537073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7170d9c-168d-4865-a3eb-86d2dbd448bd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.537248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7170d9c-168d-4865-a3eb-86d2dbd448bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.537502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7170d9c-168d-4865-a3eb-86d2dbd448bd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.539237 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7170d9c-168d-4865-a3eb-86d2dbd448bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.540964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7170d9c-168d-4865-a3eb-86d2dbd448bd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.542273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75049636-e6b5-443d-bcc8-34123242b8e4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.545210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 98/191] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:15.545210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7170d9c-168d-4865-a3eb-86d2dbd448bd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.551108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33856df-b4dd-401b-abc5-09864e1227cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.551801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33856df-b4dd-401b-abc5-09864e1227cd admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.552086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33856df-b4dd-401b-abc5-09864e1227cd admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.552360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33856df-b4dd-401b-abc5-09864e1227cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.557939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7170d9c-168d-4865-a3eb-86d2dbd448bd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.560496 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33856df-b4dd-401b-abc5-09864e1227cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.562324 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33856df-b4dd-401b-abc5-09864e1227cd admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.563306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0ae1-36bd-448e-ac4a-e9da6dfa5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.564195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0ae1-36bd-448e-ac4a-e9da6dfa5f0d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.564478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0ae1-36bd-448e-ac4a-e9da6dfa5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.564757 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb0ae1-36bd-448e-ac4a-e9da6dfa5f0d admin admin] PATH_INFO: `/v3/users/9466ecd7b48f473a9b58998803276fb9` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.566008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb0ae1-36bd-448e-ac4a-e9da6dfa5f0d admin admin] RBAC: Authorizing `identity:get_user(user_id=9466ecd7b48f473a9b58998803276fb9)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.568100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb0ae1-36bd-448e-ac4a-e9da6dfa5f0d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.575030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 99/192] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/users/9466ecd7b48f473a9b58998803276fb9 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:15.575030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0ae1-36bd-448e-ac4a-e9da6dfa5f0d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.575238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 94/193] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:15.575820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33856df-b4dd-401b-abc5-09864e1227cd admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.584972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33856df-b4dd-401b-abc5-09864e1227cd admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.585934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb0ae1-36bd-448e-ac4a-e9da6dfa5f0d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.589910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ab2e-cb13-47ce-9e53-eabe58a034b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.590544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ab2e-cb13-47ce-9e53-eabe58a034b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.590756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601c344-3c60-4949-b67a-e3779e57cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.590879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ab2e-cb13-47ce-9e53-eabe58a034b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.591088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75ab2e-cb13-47ce-9e53-eabe58a034b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.591455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601c344-3c60-4949-b67a-e3779e57cce8 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.591794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601c344-3c60-4949-b67a-e3779e57cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.592071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601c344-3c60-4949-b67a-e3779e57cce8 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.592799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601c344-3c60-4949-b67a-e3779e57cce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.594757 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601c344-3c60-4949-b67a-e3779e57cce8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.598999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75ab2e-cb13-47ce-9e53-eabe58a034b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.600769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75ab2e-cb13-47ce-9e53-eabe58a034b7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.616434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 95/194] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:36:15.616434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ab2e-cb13-47ce-9e53-eabe58a034b7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.622069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 100/195] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:15 2022] POST /identity/v3/users => generated 297 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:15.627343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601c344-3c60-4949-b67a-e3779e57cce8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.633937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75ab2e-cb13-47ce-9e53-eabe58a034b7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.637856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601c344-3c60-4949-b67a-e3779e57cce8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.638733 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fad32-4ece-4720-aa81-99b7239c747e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.639654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fad32-4ece-4720-aa81-99b7239c747e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.639944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fad32-4ece-4720-aa81-99b7239c747e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.640224 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fad32-4ece-4720-aa81-99b7239c747e admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.641461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fad32-4ece-4720-aa81-99b7239c747e admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.643503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8bebc-ad66-4318-a70a-ed10c2bd9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.643708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fad32-4ece-4720-aa81-99b7239c747e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.644810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8bebc-ad66-4318-a70a-ed10c2bd9600 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.645301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8bebc-ad66-4318-a70a-ed10c2bd9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.645440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 96/196] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:15.645878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8bebc-ad66-4318-a70a-ed10c2bd9600 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.647383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8bebc-ad66-4318-a70a-ed10c2bd9600 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.650004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8bebc-ad66-4318-a70a-ed10c2bd9600 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.652164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fad32-4ece-4720-aa81-99b7239c747e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.653155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 101/197] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:15.659729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8bebc-ad66-4318-a70a-ed10c2bd9600 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:15.662807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fad32-4ece-4720-aa81-99b7239c747e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.668411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9753f7-1593-4084-91dd-001bcb4bd1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.669104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9753f7-1593-4084-91dd-001bcb4bd1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.669423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9753f7-1593-4084-91dd-001bcb4bd1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.669749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9753f7-1593-4084-91dd-001bcb4bd1f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.670687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9753f7-1593-4084-91dd-001bcb4bd1f4 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=63e316d140ed4e29a50b866b5c7569f1, user.id=9466ecd7b48f473a9b58998803276fb9) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:15.671048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9753f7-1593-4084-91dd-001bcb4bd1f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.673094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9753f7-1593-4084-91dd-001bcb4bd1f4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.673575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8bebc-ad66-4318-a70a-ed10c2bd9600 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:15.679594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f13131-31fa-4b7e-a759-784995fcbf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:15.680591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f13131-31fa-4b7e-a759-784995fcbf69 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:15.681078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f13131-31fa-4b7e-a759-784995fcbf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:15.681529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f13131-31fa-4b7e-a759-784995fcbf69 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:15.682668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f13131-31fa-4b7e-a759-784995fcbf69 admin admin] RBAC: Adding query filter params (role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=63e316d140ed4e29a50b866b5c7569f1, user.id=9466ecd7b48f473a9b58998803276fb9) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:15.683325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f13131-31fa-4b7e-a759-784995fcbf69 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:15.685543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f13131-31fa-4b7e-a759-784995fcbf69 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:15.688038 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 97/198] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/role_assignments?user.id=9466ecd7b48f473a9b58998803276fb9&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:15.692736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 102/199] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:15 2022] GET /identity/v3/role_assignments?user.id=9466ecd7b48f473a9b58998803276fb9&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:16.041226 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a560c-7faf-4bb3-a656-25682bc6bd28 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:16.042061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a560c-7faf-4bb3-a656-25682bc6bd28 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:16.042312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a560c-7faf-4bb3-a656-25682bc6bd28 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:16.044480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 98/200] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:16.050030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651194-6228-4241-9c18-4dfd53a2d54d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:16.050576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651194-6228-4241-9c18-4dfd53a2d54d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:16.051097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651194-6228-4241-9c18-4dfd53a2d54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:16.073024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ef651194-6228-4241-9c18-4dfd53a2d54d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:16.074349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ef651194-6228-4241-9c18-4dfd53a2d54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:16.082931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 103/201] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:16.129017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a560c-7faf-4bb3-a656-25682bc6bd28 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:16.145309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a560c-7faf-4bb3-a656-25682bc6bd28 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:16.154114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f844ca5-5b67-4aa0-a330-999f2644774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:16.154907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f844ca5-5b67-4aa0-a330-999f2644774e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:16.155443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f844ca5-5b67-4aa0-a330-999f2644774e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:16.155744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f844ca5-5b67-4aa0-a330-999f2644774e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:16.169501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f844ca5-5b67-4aa0-a330-999f2644774e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:16.176415 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-0f844ca5-5b67-4aa0-a330-999f2644774e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 27 16:36:16.177616 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 99/202] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:16.184055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651194-6228-4241-9c18-4dfd53a2d54d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:16.193119 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651194-6228-4241-9c18-4dfd53a2d54d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:16.203693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfa92a-5d2b-4168-9519-a3bf6ede3d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:16.204356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfa92a-5d2b-4168-9519-a3bf6ede3d7a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:16.204638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfa92a-5d2b-4168-9519-a3bf6ede3d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:16.204913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfa92a-5d2b-4168-9519-a3bf6ede3d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:16.205672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfa92a-5d2b-4168-9519-a3bf6ede3d7a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:16.205975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfa92a-5d2b-4168-9519-a3bf6ede3d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:16.207697 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfa92a-5d2b-4168-9519-a3bf6ede3d7a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:16.225132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 104/203] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:16.230489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f844ca5-5b67-4aa0-a330-999f2644774e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:16.245506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f844ca5-5b67-4aa0-a330-999f2644774e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:16.254069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a62797-63f6-43a5-a7ec-bc17f2d2aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:16.254935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a62797-63f6-43a5-a7ec-bc17f2d2aa79 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:16.255218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a62797-63f6-43a5-a7ec-bc17f2d2aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:16.255499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a62797-63f6-43a5-a7ec-bc17f2d2aa79 admin admin] PATH_INFO: `/v3/users/d6c4d47cd5644378b3f6d00c16ac8017` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:16.260999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a62797-63f6-43a5-a7ec-bc17f2d2aa79 admin admin] RBAC: Authorizing `identity:get_user(user_id=d6c4d47cd5644378b3f6d00c16ac8017)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:16.263216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a62797-63f6-43a5-a7ec-bc17f2d2aa79 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:16.265019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 100/204] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:16 2022] GET /identity/v3/users/d6c4d47cd5644378b3f6d00c16ac8017 => generated 289 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:16.270367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfa92a-5d2b-4168-9519-a3bf6ede3d7a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:16.281457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfa92a-5d2b-4168-9519-a3bf6ede3d7a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:16.297637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd469a5-be5c-43dc-9922-3ed6766bffdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:16.298672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd469a5-be5c-43dc-9922-3ed6766bffdf admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:16.299153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd469a5-be5c-43dc-9922-3ed6766bffdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:16.299658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd469a5-be5c-43dc-9922-3ed6766bffdf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:16.315072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd469a5-be5c-43dc-9922-3ed6766bffdf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:16.317112 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd469a5-be5c-43dc-9922-3ed6766bffdf admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:16.329666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 105/205] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:16.334912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a62797-63f6-43a5-a7ec-bc17f2d2aa79 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:16.352395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a62797-63f6-43a5-a7ec-bc17f2d2aa79 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:16.359423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29560a19-25e9-4aa1-bfeb-cd78c60c6a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:16.360358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560a19-25e9-4aa1-bfeb-cd78c60c6a1d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:16.360654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560a19-25e9-4aa1-bfeb-cd78c60c6a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:16.360932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29560a19-25e9-4aa1-bfeb-cd78c60c6a1d admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:16.368299 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29560a19-25e9-4aa1-bfeb-cd78c60c6a1d admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:16.370446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29560a19-25e9-4aa1-bfeb-cd78c60c6a1d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:16.372471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 101/206] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:16 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:16.377943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd469a5-be5c-43dc-9922-3ed6766bffdf admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:16.392575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd469a5-be5c-43dc-9922-3ed6766bffdf admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:16.404067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39b53c-374a-434b-92d7-3c098955ac95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:16.404934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b53c-374a-434b-92d7-3c098955ac95 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:16.405700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b53c-374a-434b-92d7-3c098955ac95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:16.406174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39b53c-374a-434b-92d7-3c098955ac95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:16.407205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b53c-374a-434b-92d7-3c098955ac95 admin admin] RBAC: Adding query filter params (role.id=95dbcc27f28a4639b5489fe8b030cba3, scope.project.id=9fb3d018836e4765a6346dd80809dc63, user.id=d6c4d47cd5644378b3f6d00c16ac8017) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:16.407759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b53c-374a-434b-92d7-3c098955ac95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:16.409787 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39b53c-374a-434b-92d7-3c098955ac95 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:16.420967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 106/207] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:16 2022] GET /identity/v3/role_assignments?user.id=d6c4d47cd5644378b3f6d00c16ac8017&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=95dbcc27f28a4639b5489fe8b030cba3 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.091832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef9377-78ab-4a5f-b8aa-53d07f53e891 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.092340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef9377-78ab-4a5f-b8aa-53d07f53e891 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.092444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef9377-78ab-4a5f-b8aa-53d07f53e891 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.094145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 102/208] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:18.099404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928edc04-da71-4ad5-8c68-d26f6388ac82 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.099810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928edc04-da71-4ad5-8c68-d26f6388ac82 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.099990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928edc04-da71-4ad5-8c68-d26f6388ac82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.118214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-928edc04-da71-4ad5-8c68-d26f6388ac82 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:18.119395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-928edc04-da71-4ad5-8c68-d26f6388ac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:18.127776 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 107/209] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:18.150171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef9377-78ab-4a5f-b8aa-53d07f53e891 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.163003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef9377-78ab-4a5f-b8aa-53d07f53e891 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.167984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff524ba-58e0-429f-864f-484e2cb57815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.168880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff524ba-58e0-429f-864f-484e2cb57815 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.169165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff524ba-58e0-429f-864f-484e2cb57815 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.169441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff524ba-58e0-429f-864f-484e2cb57815 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.179887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff524ba-58e0-429f-864f-484e2cb57815 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:18.187376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-cff524ba-58e0-429f-864f-484e2cb57815 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:18.188910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 103/210] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:18.194497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928edc04-da71-4ad5-8c68-d26f6388ac82 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.201966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39c31-eddd-4df4-bb28-89c274320098 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.202257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39c31-eddd-4df4-bb28-89c274320098 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.202541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a39c31-eddd-4df4-bb28-89c274320098 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.204402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 104/211] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:18.209634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463571a-7752-41c8-ac94-cfc1a5e8ebcc None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.210084 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463571a-7752-41c8-ac94-cfc1a5e8ebcc None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.210598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463571a-7752-41c8-ac94-cfc1a5e8ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.213503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928edc04-da71-4ad5-8c68-d26f6388ac82 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.218822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f7527-bd5d-4e57-b6ba-15e49845d2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.218968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f7527-bd5d-4e57-b6ba-15e49845d2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.219154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f7527-bd5d-4e57-b6ba-15e49845d2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.219429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f7527-bd5d-4e57-b6ba-15e49845d2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.220234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f7527-bd5d-4e57-b6ba-15e49845d2a4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:18.220543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f7527-bd5d-4e57-b6ba-15e49845d2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.222147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f7527-bd5d-4e57-b6ba-15e49845d2a4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.232783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-4463571a-7752-41c8-ac94-cfc1a5e8ebcc None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:18.233971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4463571a-7752-41c8-ac94-cfc1a5e8ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:18.238132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 108/212] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.243332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f7527-bd5d-4e57-b6ba-15e49845d2a4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.245691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 105/213] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:18.257852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f7527-bd5d-4e57-b6ba-15e49845d2a4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.263299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d688e6-6f0d-4557-9a5f-b7b8f5cb57d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.264514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d688e6-6f0d-4557-9a5f-b7b8f5cb57d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.264996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d688e6-6f0d-4557-9a5f-b7b8f5cb57d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.265504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d688e6-6f0d-4557-9a5f-b7b8f5cb57d7 admin admin] PATH_INFO: `/v3/users/9466ecd7b48f473a9b58998803276fb9` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.267009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d688e6-6f0d-4557-9a5f-b7b8f5cb57d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=9466ecd7b48f473a9b58998803276fb9)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.269436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d688e6-6f0d-4557-9a5f-b7b8f5cb57d7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.270982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463571a-7752-41c8-ac94-cfc1a5e8ebcc None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.273033 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/users/9466ecd7b48f473a9b58998803276fb9 => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.274470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790631-ceef-4311-a561-d34bf59ac9aa None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.274963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790631-ceef-4311-a561-d34bf59ac9aa None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.275693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37790631-ceef-4311-a561-d34bf59ac9aa None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.278373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 110/215] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:18.279540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37790631-ceef-4311-a561-d34bf59ac9aa None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.281470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463571a-7752-41c8-ac94-cfc1a5e8ebcc None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.285870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211daf34-a7e9-4a52-b3fb-d7da9c214a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.286885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211daf34-a7e9-4a52-b3fb-d7da9c214a80 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.287171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211daf34-a7e9-4a52-b3fb-d7da9c214a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.287450 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211daf34-a7e9-4a52-b3fb-d7da9c214a80 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.292589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37790631-ceef-4311-a561-d34bf59ac9aa None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.296965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2eebd-74e5-4145-97ca-3289680b1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.297795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2eebd-74e5-4145-97ca-3289680b1db4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.298079 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2eebd-74e5-4145-97ca-3289680b1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.298353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2eebd-74e5-4145-97ca-3289680b1db4 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.299529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2eebd-74e5-4145-97ca-3289680b1db4 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.299824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211daf34-a7e9-4a52-b3fb-d7da9c214a80 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:18.301598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2eebd-74e5-4145-97ca-3289680b1db4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.303237 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 111/216] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.304470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191a78c-0bfd-4f1e-a382-2d8c547a9748 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.304760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191a78c-0bfd-4f1e-a382-2d8c547a9748 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.305041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191a78c-0bfd-4f1e-a382-2d8c547a9748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.307805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-211daf34-a7e9-4a52-b3fb-d7da9c214a80 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:18.309008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 106/217] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:18.310200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac62d8-e321-4cff-9949-da7b69c53e1c None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.310485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac62d8-e321-4cff-9949-da7b69c53e1c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.310763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac62d8-e321-4cff-9949-da7b69c53e1c None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.313587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 107/218] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:18.314237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac62d8-e321-4cff-9949-da7b69c53e1c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.322870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b191a78c-0bfd-4f1e-a382-2d8c547a9748 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:18.324163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b191a78c-0bfd-4f1e-a382-2d8c547a9748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:18.326396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac62d8-e321-4cff-9949-da7b69c53e1c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.330548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08018891-c37d-4161-980e-f066312eafbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.331394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08018891-c37d-4161-980e-f066312eafbc admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.331610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 112/219] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:18.331722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08018891-c37d-4161-980e-f066312eafbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.331979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08018891-c37d-4161-980e-f066312eafbc admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1/users/9466ecd7b48f473a9b58998803276fb9/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.332356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191a78c-0bfd-4f1e-a382-2d8c547a9748 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.336991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08018891-c37d-4161-980e-f066312eafbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e316d140ed4e29a50b866b5c7569f1, user_id=9466ecd7b48f473a9b58998803276fb9, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.340076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08018891-c37d-4161-980e-f066312eafbc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.341182 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191a78c-0bfd-4f1e-a382-2d8c547a9748 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.346833 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb604d5e-6b5e-44c0-85e5-bb4cd15293d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.347658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb604d5e-6b5e-44c0-85e5-bb4cd15293d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.347951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb604d5e-6b5e-44c0-85e5-bb4cd15293d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.348234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb604d5e-6b5e-44c0-85e5-bb4cd15293d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.348995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb604d5e-6b5e-44c0-85e5-bb4cd15293d3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:18.349304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb604d5e-6b5e-44c0-85e5-bb4cd15293d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.350887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb604d5e-6b5e-44c0-85e5-bb4cd15293d3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.356232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 108/220] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:18 2022] PUT /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1/users/9466ecd7b48f473a9b58998803276fb9/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:18.365210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 113/221] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.365210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b09c-cdc9-4afb-9642-86e8cf4f18cb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.365210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b09c-cdc9-4afb-9642-86e8cf4f18cb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.365210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3b09c-cdc9-4afb-9642-86e8cf4f18cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.365842 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08018891-c37d-4161-980e-f066312eafbc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.382837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c0f3b09c-cdc9-4afb-9642-86e8cf4f18cb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:18.384233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c0f3b09c-cdc9-4afb-9642-86e8cf4f18cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:18.443444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08018891-c37d-4161-980e-f066312eafbc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.447978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb49cf-2717-475d-87c7-6b0fec933a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.448610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 114/222] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:18.448953 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb49cf-2717-475d-87c7-6b0fec933a1c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.449207 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b09c-cdc9-4afb-9642-86e8cf4f18cb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.449301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb49cf-2717-475d-87c7-6b0fec933a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.449568 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb49cf-2717-475d-87c7-6b0fec933a1c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.459622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3b09c-cdc9-4afb-9642-86e8cf4f18cb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.465507 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb49cf-2717-475d-87c7-6b0fec933a1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:18.470531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c61a7c-2885-408a-af19-997744ef2526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.471764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c61a7c-2885-408a-af19-997744ef2526 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.472373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c61a7c-2885-408a-af19-997744ef2526 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.472662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c61a7c-2885-408a-af19-997744ef2526 admin admin] PATH_INFO: `/v3/users/9466ecd7b48f473a9b58998803276fb9` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.472829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-95cb49cf-2717-475d-87c7-6b0fec933a1c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:18.474168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c61a7c-2885-408a-af19-997744ef2526 admin admin] RBAC: Authorizing `identity:get_user(user_id=9466ecd7b48f473a9b58998803276fb9)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.474275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 109/223] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:18.476445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c61a7c-2885-408a-af19-997744ef2526 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.476758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb49cf-2717-475d-87c7-6b0fec933a1c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.478342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 115/224] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/users/9466ecd7b48f473a9b58998803276fb9 => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.481358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c61a7c-2885-408a-af19-997744ef2526 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.488370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb49cf-2717-475d-87c7-6b0fec933a1c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.493073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d4bb-6e0b-4949-9f24-4b974e4279b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.493839 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c61a7c-2885-408a-af19-997744ef2526 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.494096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d4bb-6e0b-4949-9f24-4b974e4279b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.494526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d4bb-6e0b-4949-9f24-4b974e4279b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.494766 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d4bb-6e0b-4949-9f24-4b974e4279b0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.496176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006d4bb-6e0b-4949-9f24-4b974e4279b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.497913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006d4bb-6e0b-4949-9f24-4b974e4279b0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.499188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21fc43-1b7b-436b-bb4c-e1e8f875cbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.499593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 110/225] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.500358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d4bb-6e0b-4949-9f24-4b974e4279b0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.504216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21fc43-1b7b-436b-bb4c-e1e8f875cbde admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.504617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21fc43-1b7b-436b-bb4c-e1e8f875cbde admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.505047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21fc43-1b7b-436b-bb4c-e1e8f875cbde admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.505872 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21fc43-1b7b-436b-bb4c-e1e8f875cbde admin admin] RBAC: Adding query filter params (name=member) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:18.506184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21fc43-1b7b-436b-bb4c-e1e8f875cbde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.507830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21fc43-1b7b-436b-bb4c-e1e8f875cbde admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.510567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d4bb-6e0b-4949-9f24-4b974e4279b0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.515279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9e377-838a-4bd3-bf86-28cdec074d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.516200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9e377-838a-4bd3-bf86-28cdec074d07 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.516489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9e377-838a-4bd3-bf86-28cdec074d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.516962 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9e377-838a-4bd3-bf86-28cdec074d07 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.517061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 116/226] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:18.518013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9e377-838a-4bd3-bf86-28cdec074d07 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.520163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9e377-838a-4bd3-bf86-28cdec074d07 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.522039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 111/227] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.522482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21fc43-1b7b-436b-bb4c-e1e8f875cbde admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.528229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9e377-838a-4bd3-bf86-28cdec074d07 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.533268 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21fc43-1b7b-436b-bb4c-e1e8f875cbde admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.541437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9e377-838a-4bd3-bf86-28cdec074d07 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.543375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6238fd-41f9-4770-ab3f-af17755f8292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.544126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6238fd-41f9-4770-ab3f-af17755f8292 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.544414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6238fd-41f9-4770-ab3f-af17755f8292 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.544691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6238fd-41f9-4770-ab3f-af17755f8292 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.545440 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6238fd-41f9-4770-ab3f-af17755f8292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.549557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6238fd-41f9-4770-ab3f-af17755f8292 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.550967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873930d-2597-497a-8403-8c7162350fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.551878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873930d-2597-497a-8403-8c7162350fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.552168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873930d-2597-497a-8403-8c7162350fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.552447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873930d-2597-497a-8403-8c7162350fe2 admin admin] PATH_INFO: `/v3/users/0e3ef3bb5e5648d1ac36deaa78bd3588` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.568019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873930d-2597-497a-8403-8c7162350fe2 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e3ef3bb5e5648d1ac36deaa78bd3588)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.570181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873930d-2597-497a-8403-8c7162350fe2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.570821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 117/228] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:18 2022] POST /identity/v3/users => generated 297 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:18.571487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6238fd-41f9-4770-ab3f-af17755f8292 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.576501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 112/229] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/users/0e3ef3bb5e5648d1ac36deaa78bd3588 => generated 297 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.578352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873930d-2597-497a-8403-8c7162350fe2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.586985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6238fd-41f9-4770-ab3f-af17755f8292 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.589115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873930d-2597-497a-8403-8c7162350fe2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.593342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d80ff-3dc2-49d2-b238-548453247cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.594066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4993aa-3bf3-4815-aa52-dd1bb4d4f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.594840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4993aa-3bf3-4815-aa52-dd1bb4d4f200 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.595119 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d80ff-3dc2-49d2-b238-548453247cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.595217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4993aa-3bf3-4815-aa52-dd1bb4d4f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.595494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4993aa-3bf3-4815-aa52-dd1bb4d4f200 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.595935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d80ff-3dc2-49d2-b238-548453247cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.596517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d80ff-3dc2-49d2-b238-548453247cc2 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1/users/9466ecd7b48f473a9b58998803276fb9/roles/27ceba94bdd34cc790ee9e7b8fb06d57` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.599396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d80ff-3dc2-49d2-b238-548453247cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e316d140ed4e29a50b866b5c7569f1, user_id=9466ecd7b48f473a9b58998803276fb9, role_id=27ceba94bdd34cc790ee9e7b8fb06d57)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.603428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d80ff-3dc2-49d2-b238-548453247cc2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.605060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4993aa-3bf3-4815-aa52-dd1bb4d4f200 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.607075 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4993aa-3bf3-4815-aa52-dd1bb4d4f200 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.618929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 113/230] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:18.622244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 118/231] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:18 2022] PUT /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1/users/9466ecd7b48f473a9b58998803276fb9/roles/27ceba94bdd34cc790ee9e7b8fb06d57 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:18.628875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4993aa-3bf3-4815-aa52-dd1bb4d4f200 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.642510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4993aa-3bf3-4815-aa52-dd1bb4d4f200 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.709120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f4531-3b73-4f20-8675-e6ff389e5093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.710310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4531-3b73-4f20-8675-e6ff389e5093 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.710737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4531-3b73-4f20-8675-e6ff389e5093 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.711152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f4531-3b73-4f20-8675-e6ff389e5093 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.712717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f4531-3b73-4f20-8675-e6ff389e5093 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.715889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f4531-3b73-4f20-8675-e6ff389e5093 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.718010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 114/232] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:18.724474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d80ff-3dc2-49d2-b238-548453247cc2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:18.736468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d80ff-3dc2-49d2-b238-548453247cc2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:18.741426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73476c-4990-44bd-bff0-9a7d79309ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:18.742379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73476c-4990-44bd-bff0-9a7d79309ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:18.742806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73476c-4990-44bd-bff0-9a7d79309ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:18.743234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73476c-4990-44bd-bff0-9a7d79309ff5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:18.744285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73476c-4990-44bd-bff0-9a7d79309ff5 admin admin] RBAC: Adding query filter params (role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=63e316d140ed4e29a50b866b5c7569f1, user.id=0e3ef3bb5e5648d1ac36deaa78bd3588) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:18.744780 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73476c-4990-44bd-bff0-9a7d79309ff5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:18.746864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73476c-4990-44bd-bff0-9a7d79309ff5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:18.753344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 119/233] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:18 2022] GET /identity/v3/role_assignments?user.id=0e3ef3bb5e5648d1ac36deaa78bd3588&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.122340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79849733-a78e-43d1-8a8d-de76c77b033f None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.123343 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79849733-a78e-43d1-8a8d-de76c77b033f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.123870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79849733-a78e-43d1-8a8d-de76c77b033f None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.126138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 115/234] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:21.131298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fd912-2f6a-45d8-9563-073b9a694a9b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.132105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fd912-2f6a-45d8-9563-073b9a694a9b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.132578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fd912-2f6a-45d8-9563-073b9a694a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.157914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ed7fd912-2f6a-45d8-9563-073b9a694a9b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:21.159445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ed7fd912-2f6a-45d8-9563-073b9a694a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:21.174214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 120/235] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:21.223644 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79849733-a78e-43d1-8a8d-de76c77b033f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.239465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79849733-a78e-43d1-8a8d-de76c77b033f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.246500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7a15-33a3-4f9f-8e19-3cc8656efc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.247607 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7a15-33a3-4f9f-8e19-3cc8656efc61 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.248087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7a15-33a3-4f9f-8e19-3cc8656efc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.248625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad7a15-33a3-4f9f-8e19-3cc8656efc61 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.250442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57275a-5cce-4e25-8b91-45c77ecacede None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.250944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57275a-5cce-4e25-8b91-45c77ecacede None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.251419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57275a-5cce-4e25-8b91-45c77ecacede None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.253442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 121/236] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:21.258681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85619470-f92a-4faf-889e-d41ff85a0844 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.259204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85619470-f92a-4faf-889e-d41ff85a0844 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.259712 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85619470-f92a-4faf-889e-d41ff85a0844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.286361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad7a15-33a3-4f9f-8e19-3cc8656efc61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:21.296840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-85619470-f92a-4faf-889e-d41ff85a0844 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:21.298065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-85619470-f92a-4faf-889e-d41ff85a0844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:21.298574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-6bad7a15-33a3-4f9f-8e19-3cc8656efc61 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:21.300584 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 116/237] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:21.308015 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7a15-33a3-4f9f-8e19-3cc8656efc61 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.315059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 122/238] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:21.319139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad7a15-33a3-4f9f-8e19-3cc8656efc61 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.324862 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893550b-f97b-4ae1-b818-258020af86b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.325836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893550b-f97b-4ae1-b818-258020af86b5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.326312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893550b-f97b-4ae1-b818-258020af86b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.326778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893550b-f97b-4ae1-b818-258020af86b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.327961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893550b-f97b-4ae1-b818-258020af86b5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:21.328462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893550b-f97b-4ae1-b818-258020af86b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.330254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893550b-f97b-4ae1-b818-258020af86b5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.340867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 117/239] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:21.347438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85619470-f92a-4faf-889e-d41ff85a0844 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.349090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b264-bd9c-4c11-88c7-ad74ca3d5d7b None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.349575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b264-bd9c-4c11-88c7-ad74ca3d5d7b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.350061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b264-bd9c-4c11-88c7-ad74ca3d5d7b None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.352070 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 118/240] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:21.353012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2b264-bd9c-4c11-88c7-ad74ca3d5d7b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.360856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85619470-f92a-4faf-889e-d41ff85a0844 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.365320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b410ac-b2fb-41b9-b777-d248a160fafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.366398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b410ac-b2fb-41b9-b777-d248a160fafc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.366684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b410ac-b2fb-41b9-b777-d248a160fafc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.367002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b410ac-b2fb-41b9-b777-d248a160fafc admin admin] PATH_INFO: `/v3/users/9466ecd7b48f473a9b58998803276fb9` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.367164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2b264-bd9c-4c11-88c7-ad74ca3d5d7b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.368399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b410ac-b2fb-41b9-b777-d248a160fafc admin admin] RBAC: Authorizing `identity:get_user(user_id=9466ecd7b48f473a9b58998803276fb9)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.370930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b410ac-b2fb-41b9-b777-d248a160fafc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.371791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68640cad-125a-41ff-85ee-e69006d02f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.372645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68640cad-125a-41ff-85ee-e69006d02f21 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.372910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68640cad-125a-41ff-85ee-e69006d02f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.373017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 123/241] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/users/9466ecd7b48f473a9b58998803276fb9 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.373192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68640cad-125a-41ff-85ee-e69006d02f21 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.374083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1b04c-bc06-4047-8c55-f0caae3635b5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.374373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1b04c-bc06-4047-8c55-f0caae3635b5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.374661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1b04c-bc06-4047-8c55-f0caae3635b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.384176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68640cad-125a-41ff-85ee-e69006d02f21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:21.392088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-68640cad-125a-41ff-85ee-e69006d02f21 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:21.393297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 119/242] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:21.394071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68640cad-125a-41ff-85ee-e69006d02f21 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.397594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-06a1b04c-bc06-4047-8c55-f0caae3635b5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:21.398862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-06a1b04c-bc06-4047-8c55-f0caae3635b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:21.405033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68640cad-125a-41ff-85ee-e69006d02f21 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.407420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 124/243] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:21.408315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1b04c-bc06-4047-8c55-f0caae3635b5 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.425511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1b04c-bc06-4047-8c55-f0caae3635b5 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.428660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a76e6-2c51-46c5-bd09-5040b87327ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.429329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a76e6-2c51-46c5-bd09-5040b87327ba admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.429723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a76e6-2c51-46c5-bd09-5040b87327ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.430008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a76e6-2c51-46c5-bd09-5040b87327ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.435336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1eaed-261c-43d0-98fc-fd04dfa9507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.436052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1eaed-261c-43d0-98fc-fd04dfa9507a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.436339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1eaed-261c-43d0-98fc-fd04dfa9507a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.436621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1eaed-261c-43d0-98fc-fd04dfa9507a admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.437407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1eaed-261c-43d0-98fc-fd04dfa9507a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:21.437721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1eaed-261c-43d0-98fc-fd04dfa9507a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.439326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1eaed-261c-43d0-98fc-fd04dfa9507a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.440029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a76e6-2c51-46c5-bd09-5040b87327ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.441784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a76e6-2c51-46c5-bd09-5040b87327ba admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.448229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 125/244] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.449245 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1eaed-261c-43d0-98fc-fd04dfa9507a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.451403 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 120/245] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:21.456667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a76e6-2c51-46c5-bd09-5040b87327ba admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.459786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1eaed-261c-43d0-98fc-fd04dfa9507a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.465078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73638a-9dd2-4cbb-ba31-7c63c92567ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.466026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73638a-9dd2-4cbb-ba31-7c63c92567ce admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.466456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73638a-9dd2-4cbb-ba31-7c63c92567ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.466902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73638a-9dd2-4cbb-ba31-7c63c92567ce admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.467711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a76e6-2c51-46c5-bd09-5040b87327ba admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.472107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63b0a0-697d-4618-99ff-c9d6a6271188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.472961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b0a0-697d-4618-99ff-c9d6a6271188 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.473244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b0a0-697d-4618-99ff-c9d6a6271188 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.473523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b0a0-697d-4618-99ff-c9d6a6271188 admin admin] PATH_INFO: `/v3/users/9466ecd7b48f473a9b58998803276fb9` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.474737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63b0a0-697d-4618-99ff-c9d6a6271188 admin admin] RBAC: Authorizing `identity:get_user(user_id=9466ecd7b48f473a9b58998803276fb9)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.476901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63b0a0-697d-4618-99ff-c9d6a6271188 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.478647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 121/246] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/users/9466ecd7b48f473a9b58998803276fb9 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.479245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63b0a0-697d-4618-99ff-c9d6a6271188 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.479870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73638a-9dd2-4cbb-ba31-7c63c92567ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:21.487164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-2c73638a-9dd2-4cbb-ba31-7c63c92567ce admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 27 16:36:21.488819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 126/247] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:21.493809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63b0a0-697d-4618-99ff-c9d6a6271188 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.493932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73638a-9dd2-4cbb-ba31-7c63c92567ce admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.505426 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b091dc1-bca8-43fc-919c-611b577f115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.506120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73638a-9dd2-4cbb-ba31-7c63c92567ce admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.507178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091dc1-bca8-43fc-919c-611b577f115d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.507807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091dc1-bca8-43fc-919c-611b577f115d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.508341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091dc1-bca8-43fc-919c-611b577f115d admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.510089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b091dc1-bca8-43fc-919c-611b577f115d admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.511076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe16d7-59d9-4e93-bbe7-1641a9f4f195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.511790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe16d7-59d9-4e93-bbe7-1641a9f4f195 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.512148 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe16d7-59d9-4e93-bbe7-1641a9f4f195 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.512500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fe16d7-59d9-4e93-bbe7-1641a9f4f195 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.513746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b091dc1-bca8-43fc-919c-611b577f115d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.515684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 122/248] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.516617 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b091dc1-bca8-43fc-919c-611b577f115d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.529638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b091dc1-bca8-43fc-919c-611b577f115d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.531638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe16d7-59d9-4e93-bbe7-1641a9f4f195 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.533573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fe16d7-59d9-4e93-bbe7-1641a9f4f195 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.536190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a082f98-4656-4fd7-8ad5-64d2eda78834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.537164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a082f98-4656-4fd7-8ad5-64d2eda78834 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.537904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a082f98-4656-4fd7-8ad5-64d2eda78834 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.538411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a082f98-4656-4fd7-8ad5-64d2eda78834 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.540340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a082f98-4656-4fd7-8ad5-64d2eda78834 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:21.541157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a082f98-4656-4fd7-8ad5-64d2eda78834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.543657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a082f98-4656-4fd7-8ad5-64d2eda78834 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.549684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 127/249] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:21.550770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe16d7-59d9-4e93-bbe7-1641a9f4f195 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.554114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 123/250] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.555421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a082f98-4656-4fd7-8ad5-64d2eda78834 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.561882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fe16d7-59d9-4e93-bbe7-1641a9f4f195 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.566940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a0a3-d2a0-4a5f-afb5-49383e472100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.567846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a0a3-d2a0-4a5f-afb5-49383e472100 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.568275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a0a3-d2a0-4a5f-afb5-49383e472100 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.568721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895a0a3-d2a0-4a5f-afb5-49383e472100 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.569100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a082f98-4656-4fd7-8ad5-64d2eda78834 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.569877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a0a3-d2a0-4a5f-afb5-49383e472100 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=63e316d140ed4e29a50b866b5c7569f1, user.id=9466ecd7b48f473a9b58998803276fb9) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:21.570602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a0a3-d2a0-4a5f-afb5-49383e472100 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.572628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895a0a3-d2a0-4a5f-afb5-49383e472100 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.574775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0808ac2-7aea-4f8f-9659-84b5126cc8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.576020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0808ac2-7aea-4f8f-9659-84b5126cc8fa admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.576403 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0808ac2-7aea-4f8f-9659-84b5126cc8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.576770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0808ac2-7aea-4f8f-9659-84b5126cc8fa admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.578556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0808ac2-7aea-4f8f-9659-84b5126cc8fa admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.580958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 128/251] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/role_assignments?user.id=9466ecd7b48f473a9b58998803276fb9&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.587608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0808ac2-7aea-4f8f-9659-84b5126cc8fa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.587608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 124/252] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:21.587840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a0a3-d2a0-4a5f-afb5-49383e472100 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.588978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0808ac2-7aea-4f8f-9659-84b5126cc8fa admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.598764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895a0a3-d2a0-4a5f-afb5-49383e472100 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.600718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0808ac2-7aea-4f8f-9659-84b5126cc8fa admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.604321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaba879-f301-4396-86d9-8ec1b866e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.605696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaba879-f301-4396-86d9-8ec1b866e599 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.606085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426462d5-e132-44ac-b58d-8fac04747ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.606353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaba879-f301-4396-86d9-8ec1b866e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.606756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426462d5-e132-44ac-b58d-8fac04747ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.606928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaba879-f301-4396-86d9-8ec1b866e599 admin admin] PATH_INFO: `/v3/users/456497305fab4eec92a849d49baf0703` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.607028 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426462d5-e132-44ac-b58d-8fac04747ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.607300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426462d5-e132-44ac-b58d-8fac04747ba8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.608384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426462d5-e132-44ac-b58d-8fac04747ba8 admin admin] RBAC: Adding query filter params (role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=63e316d140ed4e29a50b866b5c7569f1, user.id=9466ecd7b48f473a9b58998803276fb9) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:21.608704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426462d5-e132-44ac-b58d-8fac04747ba8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.611856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426462d5-e132-44ac-b58d-8fac04747ba8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.627732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 125/253] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/role_assignments?user.id=9466ecd7b48f473a9b58998803276fb9&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.627732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968477b-3295-4a05-886c-a1758659e02d None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.627732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968477b-3295-4a05-886c-a1758659e02d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.627732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968477b-3295-4a05-886c-a1758659e02d None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.627732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 126/254] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:21.633956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e796f1-a722-4d13-bfa0-17989f75093a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.634237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e796f1-a722-4d13-bfa0-17989f75093a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.634517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e796f1-a722-4d13-bfa0-17989f75093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.634804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaba879-f301-4396-86d9-8ec1b866e599 admin admin] RBAC: Authorizing `identity:get_user(user_id=456497305fab4eec92a849d49baf0703)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.638192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaba879-f301-4396-86d9-8ec1b866e599 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.645551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 129/255] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/users/456497305fab4eec92a849d49baf0703 => generated 297 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.646543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaba879-f301-4396-86d9-8ec1b866e599 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.662355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-a8e796f1-a722-4d13-bfa0-17989f75093a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:21.663629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a8e796f1-a722-4d13-bfa0-17989f75093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:21.673581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaba879-f301-4396-86d9-8ec1b866e599 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.675793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 127/256] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Jan 27 16:36:21.689500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57377f1c-cc7b-44da-943a-6241507fdde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.690168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57377f1c-cc7b-44da-943a-6241507fdde7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.690449 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57377f1c-cc7b-44da-943a-6241507fdde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.690724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57377f1c-cc7b-44da-943a-6241507fdde7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.702091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e796f1-a722-4d13-bfa0-17989f75093a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.710311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57377f1c-cc7b-44da-943a-6241507fdde7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.712152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57377f1c-cc7b-44da-943a-6241507fdde7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.712996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e796f1-a722-4d13-bfa0-17989f75093a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.718593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9563dc-ed39-4731-8e2e-84970e65bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.719821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9563dc-ed39-4731-8e2e-84970e65bed7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.720358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9563dc-ed39-4731-8e2e-84970e65bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.720871 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9563dc-ed39-4731-8e2e-84970e65bed7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.728488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 130/257] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:21.734611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57377f1c-cc7b-44da-943a-6241507fdde7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.737074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9563dc-ed39-4731-8e2e-84970e65bed7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:21.744744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-2b9563dc-ed39-4731-8e2e-84970e65bed7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:21.747022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 128/258] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:21.751722 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57377f1c-cc7b-44da-943a-6241507fdde7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.753483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9563dc-ed39-4731-8e2e-84970e65bed7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.764600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9563dc-ed39-4731-8e2e-84970e65bed7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.769304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da407b-da8f-43a4-b0e2-189cfde87201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.770151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58c09-6530-4664-ba4c-6a5eb51eb265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.770271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da407b-da8f-43a4-b0e2-189cfde87201 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.770488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da407b-da8f-43a4-b0e2-189cfde87201 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.770772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da407b-da8f-43a4-b0e2-189cfde87201 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.771709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58c09-6530-4664-ba4c-6a5eb51eb265 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.772234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58c09-6530-4664-ba4c-6a5eb51eb265 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.772736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd58c09-6530-4664-ba4c-6a5eb51eb265 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.773776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58c09-6530-4664-ba4c-6a5eb51eb265 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:21.774333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58c09-6530-4664-ba4c-6a5eb51eb265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.776382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd58c09-6530-4664-ba4c-6a5eb51eb265 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.776537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da407b-da8f-43a4-b0e2-189cfde87201 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.778878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da407b-da8f-43a4-b0e2-189cfde87201 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.780924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 131/259] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:21.786986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da407b-da8f-43a4-b0e2-189cfde87201 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.787287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 129/260] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:21.793401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58c09-6530-4664-ba4c-6a5eb51eb265 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.803978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd58c09-6530-4664-ba4c-6a5eb51eb265 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.804659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da407b-da8f-43a4-b0e2-189cfde87201 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.808961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037e4d-d52a-44d8-824a-fff934cd5858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.810131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037e4d-d52a-44d8-824a-fff934cd5858 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.810421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037e4d-d52a-44d8-824a-fff934cd5858 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.810790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7037e4d-d52a-44d8-824a-fff934cd5858 admin admin] PATH_INFO: `/v3/users/0e3ef3bb5e5648d1ac36deaa78bd3588` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.812021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6013ed-835a-4b1a-a127-014015452beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.812225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037e4d-d52a-44d8-824a-fff934cd5858 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e3ef3bb5e5648d1ac36deaa78bd3588)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.812798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6013ed-835a-4b1a-a127-014015452beb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.813148 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6013ed-835a-4b1a-a127-014015452beb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.813486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6013ed-835a-4b1a-a127-014015452beb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.814362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7037e4d-d52a-44d8-824a-fff934cd5858 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.814471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6013ed-835a-4b1a-a127-014015452beb admin admin] RBAC: Adding query filter params (role.id=95dbcc27f28a4639b5489fe8b030cba3, scope.project.id=63e316d140ed4e29a50b866b5c7569f1, user.id=456497305fab4eec92a849d49baf0703) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:21.814801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6013ed-835a-4b1a-a127-014015452beb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.816046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 130/261] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/users/0e3ef3bb5e5648d1ac36deaa78bd3588 => generated 297 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:21.817181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6013ed-835a-4b1a-a127-014015452beb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.822359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037e4d-d52a-44d8-824a-fff934cd5858 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.824279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 132/262] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/role_assignments?user.id=456497305fab4eec92a849d49baf0703&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=95dbcc27f28a4639b5489fe8b030cba3 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:21.833361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7037e4d-d52a-44d8-824a-fff934cd5858 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.838294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c54d-fc12-4318-9c14-45a61fba5be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.839389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c54d-fc12-4318-9c14-45a61fba5be3 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.839709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c54d-fc12-4318-9c14-45a61fba5be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.839987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c54d-fc12-4318-9c14-45a61fba5be3 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.841499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77c54d-fc12-4318-9c14-45a61fba5be3 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.842885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c300b2-aa98-4510-b774-887b2fa0d619 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.843178 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c300b2-aa98-4510-b774-887b2fa0d619 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.843462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c300b2-aa98-4510-b774-887b2fa0d619 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.843816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77c54d-fc12-4318-9c14-45a61fba5be3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.845725 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 133/263] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:21.845864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 131/264] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:21.851785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b802e2-44e3-408d-9b18-296085940cff None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.852095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b802e2-44e3-408d-9b18-296085940cff None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.852190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c54d-fc12-4318-9c14-45a61fba5be3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.852338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b802e2-44e3-408d-9b18-296085940cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.863871 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c54d-fc12-4318-9c14-45a61fba5be3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.868807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6724d-b165-49cb-86ad-d3023bafeaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.869788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6724d-b165-49cb-86ad-d3023bafeaaa admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.870680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6724d-b165-49cb-86ad-d3023bafeaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.870680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6724d-b165-49cb-86ad-d3023bafeaaa admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1/users/0e3ef3bb5e5648d1ac36deaa78bd3588/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.872593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c8b802e2-44e3-408d-9b18-296085940cff None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:21.872778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6724d-b165-49cb-86ad-d3023bafeaaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e316d140ed4e29a50b866b5c7569f1, user_id=0e3ef3bb5e5648d1ac36deaa78bd3588, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.873953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c8b802e2-44e3-408d-9b18-296085940cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:21.875520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6724d-b165-49cb-86ad-d3023bafeaaa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:21.882833 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 134/265] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:21.892985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 132/266] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:21 2022] PUT /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1/users/0e3ef3bb5e5648d1ac36deaa78bd3588/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:21.912202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b802e2-44e3-408d-9b18-296085940cff None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:21.923190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b802e2-44e3-408d-9b18-296085940cff None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:21.992155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224fdad-0247-440a-a9ce-5107e1759214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:21.993416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224fdad-0247-440a-a9ce-5107e1759214 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:21.994126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224fdad-0247-440a-a9ce-5107e1759214 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:21.994689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224fdad-0247-440a-a9ce-5107e1759214 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:21.996786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224fdad-0247-440a-a9ce-5107e1759214 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:21.998737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224fdad-0247-440a-a9ce-5107e1759214 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:22.000792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 135/267] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:22.007188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6724d-b165-49cb-86ad-d3023bafeaaa admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:22.022540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6724d-b165-49cb-86ad-d3023bafeaaa admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:22.027445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22434464-64d7-471f-9b56-8ab75b3b16e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:22.028308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22434464-64d7-471f-9b56-8ab75b3b16e2 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:22.028593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22434464-64d7-471f-9b56-8ab75b3b16e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:22.028870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22434464-64d7-471f-9b56-8ab75b3b16e2 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:22.029622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22434464-64d7-471f-9b56-8ab75b3b16e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:22.031865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22434464-64d7-471f-9b56-8ab75b3b16e2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:22.055519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 133/268] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:22 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:24.128855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740fdfc-28a0-434d-b610-240d1900a16e None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.129399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740fdfc-28a0-434d-b610-240d1900a16e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.129399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740fdfc-28a0-434d-b610-240d1900a16e None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.131207 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 136/269] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:24.137345 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf242f0-bcbe-4536-8d3b-c609f56ae089 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.137756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf242f0-bcbe-4536-8d3b-c609f56ae089 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.137942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf242f0-bcbe-4536-8d3b-c609f56ae089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.156049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8cf242f0-bcbe-4536-8d3b-c609f56ae089 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:24.157231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8cf242f0-bcbe-4536-8d3b-c609f56ae089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:24.164306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051513d-f1d6-44ca-af38-2ab5ef4f7570 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.164591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051513d-f1d6-44ca-af38-2ab5ef4f7570 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.164871 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051513d-f1d6-44ca-af38-2ab5ef4f7570 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.165898 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 134/270] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:24.166965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 137/271] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:24.175910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77719e-5e09-4587-af9a-5506c82f45b1 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.176199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77719e-5e09-4587-af9a-5506c82f45b1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.176481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77719e-5e09-4587-af9a-5506c82f45b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.192231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051513d-f1d6-44ca-af38-2ab5ef4f7570 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.194298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-9d77719e-5e09-4587-af9a-5506c82f45b1 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:24.195494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9d77719e-5e09-4587-af9a-5506c82f45b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:24.207147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 135/272] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:24.207531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051513d-f1d6-44ca-af38-2ab5ef4f7570 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.215442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65613-8733-4cd4-975b-541bab6e9efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.216437 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65613-8733-4cd4-975b-541bab6e9efd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.216804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65613-8733-4cd4-975b-541bab6e9efd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.217167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65613-8733-4cd4-975b-541bab6e9efd admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.230957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c65613-8733-4cd4-975b-541bab6e9efd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:24.235514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77719e-5e09-4587-af9a-5506c82f45b1 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.238358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-14c65613-8733-4cd4-975b-541bab6e9efd admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 27 16:36:24.239617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 138/273] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:24.245770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65613-8733-4cd4-975b-541bab6e9efd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.247060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77719e-5e09-4587-af9a-5506c82f45b1 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.251814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fd395-6c20-4de8-b60c-78d986abead6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.252850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fd395-6c20-4de8-b60c-78d986abead6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.253325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fd395-6c20-4de8-b60c-78d986abead6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.253792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fd395-6c20-4de8-b60c-78d986abead6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.256592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65613-8733-4cd4-975b-541bab6e9efd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.263909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637c34-b612-4578-8200-5174e6e7bc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.264559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637c34-b612-4578-8200-5174e6e7bc81 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.264845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637c34-b612-4578-8200-5174e6e7bc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.265125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637c34-b612-4578-8200-5174e6e7bc81 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.265886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637c34-b612-4578-8200-5174e6e7bc81 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:24.266195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637c34-b612-4578-8200-5174e6e7bc81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.267877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e637c34-b612-4578-8200-5174e6e7bc81 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.272267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fd395-6c20-4de8-b60c-78d986abead6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:24.279181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 139/274] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:24.281158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-e29fd395-6c20-4de8-b60c-78d986abead6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:24.287140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637c34-b612-4578-8200-5174e6e7bc81 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.287417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 136/275] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:24.288751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fd395-6c20-4de8-b60c-78d986abead6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.297614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e637c34-b612-4578-8200-5174e6e7bc81 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.300992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fd395-6c20-4de8-b60c-78d986abead6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.302272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f644-ae92-4104-9e68-7a2ccb6a00f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.303218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f644-ae92-4104-9e68-7a2ccb6a00f0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.303652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f644-ae92-4104-9e68-7a2ccb6a00f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.304037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f644-ae92-4104-9e68-7a2ccb6a00f0 admin admin] PATH_INFO: `/v3/users/456497305fab4eec92a849d49baf0703` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.305374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1f644-ae92-4104-9e68-7a2ccb6a00f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=456497305fab4eec92a849d49baf0703)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.306494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c078e8-0b83-45dc-a273-1ac0e6e37a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.307287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c078e8-0b83-45dc-a273-1ac0e6e37a6e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.307797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c078e8-0b83-45dc-a273-1ac0e6e37a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.307989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1f644-ae92-4104-9e68-7a2ccb6a00f0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.308733 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c078e8-0b83-45dc-a273-1ac0e6e37a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.309639 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c078e8-0b83-45dc-a273-1ac0e6e37a6e admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:24.310059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 140/276] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/users/456497305fab4eec92a849d49baf0703 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:24.310218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c078e8-0b83-45dc-a273-1ac0e6e37a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.312096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c078e8-0b83-45dc-a273-1ac0e6e37a6e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.315448 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f644-ae92-4104-9e68-7a2ccb6a00f0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.324483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 137/277] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:24.326325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f644-ae92-4104-9e68-7a2ccb6a00f0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.331838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c078e8-0b83-45dc-a273-1ac0e6e37a6e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.333153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356fc69-1142-40ee-a667-0c5ee5530b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.334269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356fc69-1142-40ee-a667-0c5ee5530b34 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.334743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356fc69-1142-40ee-a667-0c5ee5530b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.335208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356fc69-1142-40ee-a667-0c5ee5530b34 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.336829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356fc69-1142-40ee-a667-0c5ee5530b34 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.340292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356fc69-1142-40ee-a667-0c5ee5530b34 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.341588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c078e8-0b83-45dc-a273-1ac0e6e37a6e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.342895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 141/278] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:24.346620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232595c8-bbda-4c0d-9a81-80aa642408b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.347953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356fc69-1142-40ee-a667-0c5ee5530b34 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.348428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232595c8-bbda-4c0d-9a81-80aa642408b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.348698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232595c8-bbda-4c0d-9a81-80aa642408b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.348984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232595c8-bbda-4c0d-9a81-80aa642408b8 admin admin] PATH_INFO: `/v3/users/0e3ef3bb5e5648d1ac36deaa78bd3588` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.350213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232595c8-bbda-4c0d-9a81-80aa642408b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=0e3ef3bb5e5648d1ac36deaa78bd3588)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.352370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232595c8-bbda-4c0d-9a81-80aa642408b8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.354099 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 138/279] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/users/0e3ef3bb5e5648d1ac36deaa78bd3588 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:24.359876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232595c8-bbda-4c0d-9a81-80aa642408b8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.360819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356fc69-1142-40ee-a667-0c5ee5530b34 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.365587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c4b63-1a39-4fe2-a60c-734042ea8456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.367085 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c4b63-1a39-4fe2-a60c-734042ea8456 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.367803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c4b63-1a39-4fe2-a60c-734042ea8456 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.368224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c4b63-1a39-4fe2-a60c-734042ea8456 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1/users/456497305fab4eec92a849d49baf0703/roles/95dbcc27f28a4639b5489fe8b030cba3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.369729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232595c8-bbda-4c0d-9a81-80aa642408b8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.370743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c4b63-1a39-4fe2-a60c-734042ea8456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e316d140ed4e29a50b866b5c7569f1, user_id=456497305fab4eec92a849d49baf0703, role_id=95dbcc27f28a4639b5489fe8b030cba3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.374549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c4b63-1a39-4fe2-a60c-734042ea8456 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.374689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab440ba2-781a-4b94-9265-5123ce9c7f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.375396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab440ba2-781a-4b94-9265-5123ce9c7f4c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.375820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab440ba2-781a-4b94-9265-5123ce9c7f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.376198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab440ba2-781a-4b94-9265-5123ce9c7f4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.385438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab440ba2-781a-4b94-9265-5123ce9c7f4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.388040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab440ba2-781a-4b94-9265-5123ce9c7f4c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.393852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 142/280] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:24 2022] PUT /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1/users/456497305fab4eec92a849d49baf0703/roles/95dbcc27f28a4639b5489fe8b030cba3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:36:24.400907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 139/281] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:24.407134 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c4b63-1a39-4fe2-a60c-734042ea8456 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.467633 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43df24-32c0-4faa-8962-ff907e53cd86 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.468189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43df24-32c0-4faa-8962-ff907e53cd86 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.468916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43df24-32c0-4faa-8962-ff907e53cd86 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.470907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 140/282] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:24.472195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e23d-769e-47ea-b430-dc4175e5a6c7 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.472538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e23d-769e-47ea-b430-dc4175e5a6c7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.472819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e23d-769e-47ea-b430-dc4175e5a6c7 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.474970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 141/283] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:24.477066 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c4b63-1a39-4fe2-a60c-734042ea8456 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.479175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1f967-59e0-458b-891d-7f8455a8fffb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.479584 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1f967-59e0-458b-891d-7f8455a8fffb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.480116 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1f967-59e0-458b-891d-7f8455a8fffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.482296 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee823c-5650-45f6-979d-25b11f241db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.483170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee823c-5650-45f6-979d-25b11f241db5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.483454 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee823c-5650-45f6-979d-25b11f241db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.483774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee823c-5650-45f6-979d-25b11f241db5 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.485097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee823c-5650-45f6-979d-25b11f241db5 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.487358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee823c-5650-45f6-979d-25b11f241db5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.489157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 143/284] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:24.490266 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28149-b624-4274-8806-499b3ab41f19 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.490557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28149-b624-4274-8806-499b3ab41f19 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.490839 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc28149-b624-4274-8806-499b3ab41f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.501403 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-26b1f967-59e0-458b-891d-7f8455a8fffb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:24.502743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-26b1f967-59e0-458b-891d-7f8455a8fffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:24.510633 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 142/285] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:24.511964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1f967-59e0-458b-891d-7f8455a8fffb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.521779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1dc28149-b624-4274-8806-499b3ab41f19 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:24.523265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1dc28149-b624-4274-8806-499b3ab41f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:24.523821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1f967-59e0-458b-891d-7f8455a8fffb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.529643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c8192-8ed1-469a-a769-112377cb5a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.530468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c8192-8ed1-469a-a769-112377cb5a73 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.531104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c8192-8ed1-469a-a769-112377cb5a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.531505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c8192-8ed1-469a-a769-112377cb5a73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.532466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c8192-8ed1-469a-a769-112377cb5a73 admin admin] RBAC: Adding query filter params (role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=63e316d140ed4e29a50b866b5c7569f1, user.id=0e3ef3bb5e5648d1ac36deaa78bd3588) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:24.532861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c8192-8ed1-469a-a769-112377cb5a73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.534143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 144/286] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:24.535092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8c8192-8ed1-469a-a769-112377cb5a73 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.535731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc28149-b624-4274-8806-499b3ab41f19 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.543272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 143/287] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/role_assignments?user.id=0e3ef3bb5e5648d1ac36deaa78bd3588&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:24.554704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc28149-b624-4274-8806-499b3ab41f19 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.561441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617cfe-8ac6-4c40-b9a3-05d8c1cc4251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.562447 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617cfe-8ac6-4c40-b9a3-05d8c1cc4251 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.562832 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617cfe-8ac6-4c40-b9a3-05d8c1cc4251 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.563214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55617cfe-8ac6-4c40-b9a3-05d8c1cc4251 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.566217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c8192-8ed1-469a-a769-112377cb5a73 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.577290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c8192-8ed1-469a-a769-112377cb5a73 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.578981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55617cfe-8ac6-4c40-b9a3-05d8c1cc4251 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:24.581928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded05cde-2638-4455-8aa8-27ff66a25189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.582737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05cde-2638-4455-8aa8-27ff66a25189 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.583017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05cde-2638-4455-8aa8-27ff66a25189 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.583289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded05cde-2638-4455-8aa8-27ff66a25189 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.584619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded05cde-2638-4455-8aa8-27ff66a25189 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.586351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded05cde-2638-4455-8aa8-27ff66a25189 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.586878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-55617cfe-8ac6-4c40-b9a3-05d8c1cc4251 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:24.589830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 144/288] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:24.590012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 145/289] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:24.594054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded05cde-2638-4455-8aa8-27ff66a25189 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.595662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617cfe-8ac6-4c40-b9a3-05d8c1cc4251 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.604367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded05cde-2638-4455-8aa8-27ff66a25189 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.606866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55617cfe-8ac6-4c40-b9a3-05d8c1cc4251 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.613332 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef712bc5-12d6-4a05-9a66-4bf42905a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.613995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef712bc5-12d6-4a05-9a66-4bf42905a90d admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.614287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef712bc5-12d6-4a05-9a66-4bf42905a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.614559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef712bc5-12d6-4a05-9a66-4bf42905a90d admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.614656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8681-1cec-4d72-ad9d-7b188929169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.615297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8681-1cec-4d72-ad9d-7b188929169e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.615397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef712bc5-12d6-4a05-9a66-4bf42905a90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.615675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8681-1cec-4d72-ad9d-7b188929169e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.615991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe8681-1cec-4d72-ad9d-7b188929169e admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.617064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe8681-1cec-4d72-ad9d-7b188929169e admin admin] RBAC: Adding query filter params (name=member) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:24.617331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef712bc5-12d6-4a05-9a66-4bf42905a90d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.617499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe8681-1cec-4d72-ad9d-7b188929169e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.619122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe8681-1cec-4d72-ad9d-7b188929169e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.629876 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 146/290] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:24.637202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8681-1cec-4d72-ad9d-7b188929169e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.640964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 145/291] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:24 2022] POST /identity/v3/users => generated 293 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:24.648561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe8681-1cec-4d72-ad9d-7b188929169e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.655369 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06ab33-4e96-4105-8e36-b420954f3d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.656569 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06ab33-4e96-4105-8e36-b420954f3d01 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.656856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06ab33-4e96-4105-8e36-b420954f3d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.657137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06ab33-4e96-4105-8e36-b420954f3d01 admin admin] PATH_INFO: `/v3/users/567e1645756a4c279bcac4e2fa46140e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.673303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06ab33-4e96-4105-8e36-b420954f3d01 admin admin] RBAC: Authorizing `identity:get_user(user_id=567e1645756a4c279bcac4e2fa46140e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.675631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06ab33-4e96-4105-8e36-b420954f3d01 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.677814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 147/292] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/users/567e1645756a4c279bcac4e2fa46140e => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:24.685251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef712bc5-12d6-4a05-9a66-4bf42905a90d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:24.695837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef712bc5-12d6-4a05-9a66-4bf42905a90d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:24.702620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4494b6-64be-4b8c-aea1-40ac1af798ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:24.703309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4494b6-64be-4b8c-aea1-40ac1af798ab admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:24.703615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4494b6-64be-4b8c-aea1-40ac1af798ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:24.703898 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4494b6-64be-4b8c-aea1-40ac1af798ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:24.704832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4494b6-64be-4b8c-aea1-40ac1af798ab admin admin] RBAC: Adding query filter params (role.id=77071b28cf624ed1b3bd0dd30d0910b2, user.id=567e1645756a4c279bcac4e2fa46140e, scope.system=all) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:24.705150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4494b6-64be-4b8c-aea1-40ac1af798ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:24.707165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4494b6-64be-4b8c-aea1-40ac1af798ab admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:24.717170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 146/293] 10.222.0.48 () {56 vars in 1329 bytes} [Thu Jan 27 16:36:24 2022] GET /identity/v3/role_assignments?user.id=567e1645756a4c279bcac4e2fa46140e&scope.system=all&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:26.836562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320cba-14c8-4908-8f82-456d7b496aa2 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:26.837225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320cba-14c8-4908-8f82-456d7b496aa2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:26.837225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320cba-14c8-4908-8f82-456d7b496aa2 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:26.839618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 148/294] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:26.846003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823c0d1-09a7-48d3-88f9-fd5791b36d43 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:26.846535 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823c0d1-09a7-48d3-88f9-fd5791b36d43 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:26.846535 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823c0d1-09a7-48d3-88f9-fd5791b36d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:26.864521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-a823c0d1-09a7-48d3-88f9-fd5791b36d43 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:26.865730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a823c0d1-09a7-48d3-88f9-fd5791b36d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:26.873984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 147/295] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:26.897089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320cba-14c8-4908-8f82-456d7b496aa2 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:26.910239 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320cba-14c8-4908-8f82-456d7b496aa2 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:26.914536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c3d71-baf0-4c17-94ec-69dd47ab42dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:26.915320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c3d71-baf0-4c17-94ec-69dd47ab42dd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:26.915618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c3d71-baf0-4c17-94ec-69dd47ab42dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:26.915896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c3d71-baf0-4c17-94ec-69dd47ab42dd admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:26.926698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c3d71-baf0-4c17-94ec-69dd47ab42dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:26.934191 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-662c3d71-baf0-4c17-94ec-69dd47ab42dd admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 27 16:36:26.935709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 149/296] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:26.941669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823c0d1-09a7-48d3-88f9-fd5791b36d43 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:26.949439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c4a2e-3f5e-4f51-be38-7870378eeef9 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:26.949724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c4a2e-3f5e-4f51-be38-7870378eeef9 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:26.950001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c4a2e-3f5e-4f51-be38-7870378eeef9 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:26.951900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 150/297] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:26.954171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823c0d1-09a7-48d3-88f9-fd5791b36d43 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:26.957401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ca3f0-3bca-40b1-a46b-ff3f2b0eea80 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:26.957903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ca3f0-3bca-40b1-a46b-ff3f2b0eea80 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:26.958383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ca3f0-3bca-40b1-a46b-ff3f2b0eea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:26.958664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af2026-8c31-4442-be48-49dd42079e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:26.959325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af2026-8c31-4442-be48-49dd42079e4a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:26.959635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af2026-8c31-4442-be48-49dd42079e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:26.959912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af2026-8c31-4442-be48-49dd42079e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:26.960673 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af2026-8c31-4442-be48-49dd42079e4a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:26.960975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af2026-8c31-4442-be48-49dd42079e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:26.962579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af2026-8c31-4442-be48-49dd42079e4a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:26.978429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 148/298] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:26.979717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af2026-8c31-4442-be48-49dd42079e4a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:26.980802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-955ca3f0-3bca-40b1-a46b-ff3f2b0eea80 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:26.982006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-955ca3f0-3bca-40b1-a46b-ff3f2b0eea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:26.989609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 151/299] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:26.990603 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af2026-8c31-4442-be48-49dd42079e4a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:26.995279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ae04-5162-406b-9744-46f1fd5d13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:26.997127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ae04-5162-406b-9744-46f1fd5d13fe admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:26.997618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ae04-5162-406b-9744-46f1fd5d13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:26.998119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ae04-5162-406b-9744-46f1fd5d13fe admin admin] PATH_INFO: `/v3/users/456497305fab4eec92a849d49baf0703` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:26.999548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203ae04-5162-406b-9744-46f1fd5d13fe admin admin] RBAC: Authorizing `identity:get_user(user_id=456497305fab4eec92a849d49baf0703)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.001923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203ae04-5162-406b-9744-46f1fd5d13fe admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.004012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 149/300] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:26 2022] GET /identity/v3/users/456497305fab4eec92a849d49baf0703 => generated 297 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:27.009501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ca3f0-3bca-40b1-a46b-ff3f2b0eea80 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.015950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ae04-5162-406b-9744-46f1fd5d13fe admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.020190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ca3f0-3bca-40b1-a46b-ff3f2b0eea80 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.024658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7948e20-6d48-4ed7-b977-d4b942db6512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.025303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948e20-6d48-4ed7-b977-d4b942db6512 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.025585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948e20-6d48-4ed7-b977-d4b942db6512 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.025860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7948e20-6d48-4ed7-b977-d4b942db6512 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.027109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ae04-5162-406b-9744-46f1fd5d13fe admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.032078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e244ed1-0fc0-40c7-914a-cf2a7ac8075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.032869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e244ed1-0fc0-40c7-914a-cf2a7ac8075c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.033156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e244ed1-0fc0-40c7-914a-cf2a7ac8075c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.033436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e244ed1-0fc0-40c7-914a-cf2a7ac8075c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.034700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7948e20-6d48-4ed7-b977-d4b942db6512 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.036488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7948e20-6d48-4ed7-b977-d4b942db6512 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.045002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e244ed1-0fc0-40c7-914a-cf2a7ac8075c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:27.046383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 152/301] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:27.047488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5356b3-abb4-4d05-a114-33f45e208441 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.048856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5356b3-abb4-4d05-a114-33f45e208441 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.049371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5356b3-abb4-4d05-a114-33f45e208441 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.053972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-8e244ed1-0fc0-40c7-914a-cf2a7ac8075c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:27.054374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 153/302] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:27.055253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5356b3-abb4-4d05-a114-33f45e208441 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.057724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 150/303] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:27.059070 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e244ed1-0fc0-40c7-914a-cf2a7ac8075c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.069334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e244ed1-0fc0-40c7-914a-cf2a7ac8075c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.069673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5356b3-abb4-4d05-a114-33f45e208441 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.074025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9417b-001a-4244-88d8-27e79353962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.074153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dec521-864e-46ea-8d47-d5968a3c12a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.074868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dec521-864e-46ea-8d47-d5968a3c12a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.075150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dec521-864e-46ea-8d47-d5968a3c12a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.075349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9417b-001a-4244-88d8-27e79353962b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.075444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dec521-864e-46ea-8d47-d5968a3c12a9 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.075908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9417b-001a-4244-88d8-27e79353962b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.076411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9417b-001a-4244-88d8-27e79353962b admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.076769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dec521-864e-46ea-8d47-d5968a3c12a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.077514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9417b-001a-4244-88d8-27e79353962b admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:27.078060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9417b-001a-4244-88d8-27e79353962b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.078796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dec521-864e-46ea-8d47-d5968a3c12a9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.079801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9417b-001a-4244-88d8-27e79353962b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.080469 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 154/304] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:27.081580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743e34-f87d-46d9-8c45-5c5e75404908 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.081868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743e34-f87d-46d9-8c45-5c5e75404908 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.082503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743e34-f87d-46d9-8c45-5c5e75404908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.093659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 151/305] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:27.093659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16811524-a603-42a6-b69b-178ae6fa3157 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.093659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16811524-a603-42a6-b69b-178ae6fa3157 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.093659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16811524-a603-42a6-b69b-178ae6fa3157 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.093989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 152/306] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:27.094476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16811524-a603-42a6-b69b-178ae6fa3157 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.099537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-53743e34-f87d-46d9-8c45-5c5e75404908 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:27.100725 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-53743e34-f87d-46d9-8c45-5c5e75404908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:27.107061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16811524-a603-42a6-b69b-178ae6fa3157 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.108549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 155/307] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:27.109290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53743e34-f87d-46d9-8c45-5c5e75404908 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.111404 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d754508-8360-40cf-881d-da25e5d19d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.112066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754508-8360-40cf-881d-da25e5d19d16 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.112354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754508-8360-40cf-881d-da25e5d19d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.112635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d754508-8360-40cf-881d-da25e5d19d16 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.113469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d754508-8360-40cf-881d-da25e5d19d16 admin admin] RBAC: Adding query filter params (role.id=95dbcc27f28a4639b5489fe8b030cba3, scope.project.id=63e316d140ed4e29a50b866b5c7569f1, user.id=456497305fab4eec92a849d49baf0703) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:27.113784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d754508-8360-40cf-881d-da25e5d19d16 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.115635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d754508-8360-40cf-881d-da25e5d19d16 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.122329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 153/308] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/role_assignments?user.id=456497305fab4eec92a849d49baf0703&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=95dbcc27f28a4639b5489fe8b030cba3 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:27.125808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd85d-5304-4731-8417-9b64ca8f33fb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.125808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd85d-5304-4731-8417-9b64ca8f33fb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.125808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd85d-5304-4731-8417-9b64ca8f33fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.127158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53743e34-f87d-46d9-8c45-5c5e75404908 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.136018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38ec1c-ec3b-4784-96ee-785881804b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.137073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38ec1c-ec3b-4784-96ee-785881804b23 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.137358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38ec1c-ec3b-4784-96ee-785881804b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.137628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f38ec1c-ec3b-4784-96ee-785881804b23 admin admin] PATH_INFO: `/v3/users/567e1645756a4c279bcac4e2fa46140e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.138930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38ec1c-ec3b-4784-96ee-785881804b23 admin admin] RBAC: Authorizing `identity:get_user(user_id=567e1645756a4c279bcac4e2fa46140e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.141150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f38ec1c-ec3b-4784-96ee-785881804b23 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.143180 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 156/309] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/users/567e1645756a4c279bcac4e2fa46140e => generated 293 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:27.147738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38ec1c-ec3b-4784-96ee-785881804b23 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.149003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-6b1bd85d-5304-4731-8417-9b64ca8f33fb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:27.150259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6b1bd85d-5304-4731-8417-9b64ca8f33fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:27.158058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f38ec1c-ec3b-4784-96ee-785881804b23 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.158790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 154/310] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:27.159556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd85d-5304-4731-8417-9b64ca8f33fb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.162420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a992340-2561-4a6f-aaee-72580d7e8661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.163209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a992340-2561-4a6f-aaee-72580d7e8661 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.163491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a992340-2561-4a6f-aaee-72580d7e8661 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.163796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a992340-2561-4a6f-aaee-72580d7e8661 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.171765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd85d-5304-4731-8417-9b64ca8f33fb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.174411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d7023-2d50-4e65-96c0-6ace0a628161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.175370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7023-2d50-4e65-96c0-6ace0a628161 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.175797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7023-2d50-4e65-96c0-6ace0a628161 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.176151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7023-2d50-4e65-96c0-6ace0a628161 admin admin] PATH_INFO: `/v3/system/users/567e1645756a4c279bcac4e2fa46140e/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.177813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d7023-2d50-4e65-96c0-6ace0a628161 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=567e1645756a4c279bcac4e2fa46140e, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.178938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-ec3d7023-2d50-4e65-96c0-6ace0a628161 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:27.178938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:36:27.178938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:36:27.179979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d7023-2d50-4e65-96c0-6ace0a628161 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.180917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a992340-2561-4a6f-aaee-72580d7e8661 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:27.189414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-9a992340-2561-4a6f-aaee-72580d7e8661 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 27 16:36:27.195626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 157/311] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:27.195626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a992340-2561-4a6f-aaee-72580d7e8661 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.198305 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 155/312] 10.222.0.48 () {58 vars in 1355 bytes} [Thu Jan 27 16:36:27 2022] PUT /identity/v3/system/users/567e1645756a4c279bcac4e2fa46140e/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:27.199298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d7023-2d50-4e65-96c0-6ace0a628161 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.203553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a992340-2561-4a6f-aaee-72580d7e8661 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.211755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e5d04-fd5a-4f60-bb52-6ea15e997873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.211755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e5d04-fd5a-4f60-bb52-6ea15e997873 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.211755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e5d04-fd5a-4f60-bb52-6ea15e997873 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.211755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e5d04-fd5a-4f60-bb52-6ea15e997873 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.212182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d7023-2d50-4e65-96c0-6ace0a628161 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.212550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e5d04-fd5a-4f60-bb52-6ea15e997873 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.215022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e5d04-fd5a-4f60-bb52-6ea15e997873 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.217238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 158/313] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:27.222858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae9721-c657-4c3a-8de7-ec0476d4f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.223601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae9721-c657-4c3a-8de7-ec0476d4f369 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.223968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae9721-c657-4c3a-8de7-ec0476d4f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.224259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae9721-c657-4c3a-8de7-ec0476d4f369 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.225074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae9721-c657-4c3a-8de7-ec0476d4f369 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:27.225392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae9721-c657-4c3a-8de7-ec0476d4f369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.225704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e5d04-fd5a-4f60-bb52-6ea15e997873 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.227186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae9721-c657-4c3a-8de7-ec0476d4f369 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.238010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 156/314] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:27.238645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e5d04-fd5a-4f60-bb52-6ea15e997873 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.244133 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae9721-c657-4c3a-8de7-ec0476d4f369 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.244633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef7713-b0b5-4337-9dee-688ed81ff847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.246402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7713-b0b5-4337-9dee-688ed81ff847 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.246977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7713-b0b5-4337-9dee-688ed81ff847 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.247457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7713-b0b5-4337-9dee-688ed81ff847 admin admin] PATH_INFO: `/v3/groups` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.248452 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef7713-b0b5-4337-9dee-688ed81ff847 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.249818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-4eef7713-b0b5-4337-9dee-688ed81ff847 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:27.249818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:27.249818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:27.252428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef7713-b0b5-4337-9dee-688ed81ff847 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.256147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae9721-c657-4c3a-8de7-ec0476d4f369 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.264019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e42a8d-2efc-49d5-8dff-61c777d4ad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.265022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e42a8d-2efc-49d5-8dff-61c777d4ad30 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.265319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e42a8d-2efc-49d5-8dff-61c777d4ad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.265716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e42a8d-2efc-49d5-8dff-61c777d4ad30 admin admin] PATH_INFO: `/v3/users/3ed6ee10954043d2b49acbc3695a42f0` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.274919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 159/315] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jan 27 16:36:27 2022] POST /identity/v3/groups => generated 229 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:36:27.288517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e42a8d-2efc-49d5-8dff-61c777d4ad30 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed6ee10954043d2b49acbc3695a42f0)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.291212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e42a8d-2efc-49d5-8dff-61c777d4ad30 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.293761 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 157/316] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/users/3ed6ee10954043d2b49acbc3695a42f0 => generated 293 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:27.300318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef7713-b0b5-4337-9dee-688ed81ff847 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:27.311802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef7713-b0b5-4337-9dee-688ed81ff847 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:27.316984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bd445-9a35-4df5-85a2-aa794fd6e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:27.317674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bd445-9a35-4df5-85a2-aa794fd6e3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:27.318009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bd445-9a35-4df5-85a2-aa794fd6e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:27.318297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bd445-9a35-4df5-85a2-aa794fd6e3a1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:27.319227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bd445-9a35-4df5-85a2-aa794fd6e3a1 admin admin] RBAC: Adding query filter params (role.id=95dbcc27f28a4639b5489fe8b030cba3, user.id=3ed6ee10954043d2b49acbc3695a42f0, scope.system=all) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:27.319552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bd445-9a35-4df5-85a2-aa794fd6e3a1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:27.321657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bd445-9a35-4df5-85a2-aa794fd6e3a1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:27.332273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 160/317] 10.222.0.48 () {56 vars in 1329 bytes} [Thu Jan 27 16:36:27 2022] GET /identity/v3/role_assignments?user.id=3ed6ee10954043d2b49acbc3695a42f0&scope.system=all&role.id=95dbcc27f28a4639b5489fe8b030cba3 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:29.442802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f822-74d4-4bbd-a973-2c103fda0151 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.443315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f822-74d4-4bbd-a973-2c103fda0151 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.443425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f822-74d4-4bbd-a973-2c103fda0151 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.445170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 158/318] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:29.450335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eb0c0-0bd3-4001-acc2-ec16c70d42b7 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.450749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eb0c0-0bd3-4001-acc2-ec16c70d42b7 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.450981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542eb0c0-0bd3-4001-acc2-ec16c70d42b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.469263 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-542eb0c0-0bd3-4001-acc2-ec16c70d42b7 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:29.470446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-542eb0c0-0bd3-4001-acc2-ec16c70d42b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:29.478130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 161/319] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:29.502970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f822-74d4-4bbd-a973-2c103fda0151 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.515592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f822-74d4-4bbd-a973-2c103fda0151 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.520056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf5001-e835-49ca-af4e-92b61f0d63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.521035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf5001-e835-49ca-af4e-92b61f0d63db admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.521494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf5001-e835-49ca-af4e-92b61f0d63db admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.521945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf5001-e835-49ca-af4e-92b61f0d63db admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.532714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf5001-e835-49ca-af4e-92b61f0d63db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:29.539809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-66bf5001-e835-49ca-af4e-92b61f0d63db admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:29.541180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 159/320] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:29.548222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542eb0c0-0bd3-4001-acc2-ec16c70d42b7 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.557427 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542eb0c0-0bd3-4001-acc2-ec16c70d42b7 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.562476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f471bf-2b77-4f22-99dd-9c637542075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.563248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f471bf-2b77-4f22-99dd-9c637542075d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.563537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f471bf-2b77-4f22-99dd-9c637542075d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.563848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f471bf-2b77-4f22-99dd-9c637542075d admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.564530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7452d-db70-478a-a62a-7c624e4f3be0 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.564645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f471bf-2b77-4f22-99dd-9c637542075d admin admin] RBAC: Adding query filter params (name=member) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:29.564865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7452d-db70-478a-a62a-7c624e4f3be0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.564937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f471bf-2b77-4f22-99dd-9c637542075d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:29.565209 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7452d-db70-478a-a62a-7c624e4f3be0 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.566507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f471bf-2b77-4f22-99dd-9c637542075d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:29.567322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 160/321] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:29.568428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570ef5-5cc4-45c4-afa8-e6c1eb706266 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.568765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570ef5-5cc4-45c4-afa8-e6c1eb706266 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.569049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db570ef5-5cc4-45c4-afa8-e6c1eb706266 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.570615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 161/322] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:29.572485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47b0c-0da4-4fef-894d-bc940c4c6091 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.572767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47b0c-0da4-4fef-894d-bc940c4c6091 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.573042 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47b0c-0da4-4fef-894d-bc940c4c6091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.578377 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 162/323] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:29.579635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2211c13-e144-438b-867c-3c70e7830bb2 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.579928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2211c13-e144-438b-867c-3c70e7830bb2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.580204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2211c13-e144-438b-867c-3c70e7830bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.591263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-6ea47b0c-0da4-4fef-894d-bc940c4c6091 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:29.592509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6ea47b0c-0da4-4fef-894d-bc940c4c6091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:29.597336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-f2211c13-e144-438b-867c-3c70e7830bb2 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:29.598467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f2211c13-e144-438b-867c-3c70e7830bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:29.599979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 162/324] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:29.600736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea47b0c-0da4-4fef-894d-bc940c4c6091 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.607270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 163/325] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:29.611562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea47b0c-0da4-4fef-894d-bc940c4c6091 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.615788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d2623-0a44-4085-ac14-5dadf3ac5cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.616630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d2623-0a44-4085-ac14-5dadf3ac5cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.616915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d2623-0a44-4085-ac14-5dadf3ac5cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.617198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d2623-0a44-4085-ac14-5dadf3ac5cd4 admin admin] PATH_INFO: `/v3/users/567e1645756a4c279bcac4e2fa46140e` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.618390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d2623-0a44-4085-ac14-5dadf3ac5cd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=567e1645756a4c279bcac4e2fa46140e)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:29.620578 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d2623-0a44-4085-ac14-5dadf3ac5cd4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:29.622549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 163/326] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:29 2022] GET /identity/v3/users/567e1645756a4c279bcac4e2fa46140e => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:29.625170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2211c13-e144-438b-867c-3c70e7830bb2 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.627691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d2623-0a44-4085-ac14-5dadf3ac5cd4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.634450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2211c13-e144-438b-867c-3c70e7830bb2 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.637377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d2623-0a44-4085-ac14-5dadf3ac5cd4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.639514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ebd2a-c2f1-4b97-989f-8560dca9a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.640324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ebd2a-c2f1-4b97-989f-8560dca9a494 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.640607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ebd2a-c2f1-4b97-989f-8560dca9a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.640885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ebd2a-c2f1-4b97-989f-8560dca9a494 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.641569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fceb64-a01f-4f99-be64-5540fc39c82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.642046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ebd2a-c2f1-4b97-989f-8560dca9a494 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:29.642182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fceb64-a01f-4f99-be64-5540fc39c82e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.642466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fceb64-a01f-4f99-be64-5540fc39c82e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.642747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fceb64-a01f-4f99-be64-5540fc39c82e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.643600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fceb64-a01f-4f99-be64-5540fc39c82e admin admin] RBAC: Adding query filter params (role.id=77071b28cf624ed1b3bd0dd30d0910b2, user.id=567e1645756a4c279bcac4e2fa46140e, scope.system=all) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:29.643766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ebd2a-c2f1-4b97-989f-8560dca9a494 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:29.643920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fceb64-a01f-4f99-be64-5540fc39c82e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:29.645329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 164/327] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:29.645722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fceb64-a01f-4f99-be64-5540fc39c82e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:29.646143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ebd2a-c2f1-4b97-989f-8560dca9a494 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.655340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ebd2a-c2f1-4b97-989f-8560dca9a494 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.660435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437880-f7db-43f1-946a-dce47f24c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.660548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 164/328] 10.222.0.48 () {56 vars in 1329 bytes} [Thu Jan 27 16:36:29 2022] GET /identity/v3/role_assignments?user.id=567e1645756a4c279bcac4e2fa46140e&scope.system=all&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 510 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:29.661184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437880-f7db-43f1-946a-dce47f24c85e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.661323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fceb64-a01f-4f99-be64-5540fc39c82e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.661481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437880-f7db-43f1-946a-dce47f24c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.661736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da437880-f7db-43f1-946a-dce47f24c85e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.673444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fceb64-a01f-4f99-be64-5540fc39c82e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.674843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da437880-f7db-43f1-946a-dce47f24c85e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:29.678000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee1bac-5caf-4920-9aba-a21dc2ca2422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.678763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee1bac-5caf-4920-9aba-a21dc2ca2422 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.679056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee1bac-5caf-4920-9aba-a21dc2ca2422 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.679338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee1bac-5caf-4920-9aba-a21dc2ca2422 admin admin] PATH_INFO: `/v3/groups` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.680103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee1bac-5caf-4920-9aba-a21dc2ca2422 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:29.681167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-46ee1bac-5caf-4920-9aba-a21dc2ca2422 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:29.681167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:36:29.681167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:36:29.682096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-da437880-f7db-43f1-946a-dce47f24c85e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 27 16:36:29.682380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee1bac-5caf-4920-9aba-a21dc2ca2422 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:29.684305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 165/329] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:29.690373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437880-f7db-43f1-946a-dce47f24c85e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.701756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 165/330] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Jan 27 16:36:29 2022] POST /identity/v3/groups => generated 226 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:29.702086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da437880-f7db-43f1-946a-dce47f24c85e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.706930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da841c0-9c41-4927-8ae9-bd26a3051e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.707648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da841c0-9c41-4927-8ae9-bd26a3051e78 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.707928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da841c0-9c41-4927-8ae9-bd26a3051e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.708200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da841c0-9c41-4927-8ae9-bd26a3051e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.708983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da841c0-9c41-4927-8ae9-bd26a3051e78 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:29.709288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da841c0-9c41-4927-8ae9-bd26a3051e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:29.710926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da841c0-9c41-4927-8ae9-bd26a3051e78 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:29.720882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 166/331] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:29.727724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee1bac-5caf-4920-9aba-a21dc2ca2422 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.737950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee1bac-5caf-4920-9aba-a21dc2ca2422 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.742434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe241a-fc04-4a55-8927-97ff89179b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.743344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe241a-fc04-4a55-8927-97ff89179b97 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.743675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe241a-fc04-4a55-8927-97ff89179b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.744056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe241a-fc04-4a55-8927-97ff89179b97 admin admin] PATH_INFO: `/v3/users/3ed6ee10954043d2b49acbc3695a42f0` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.745368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe241a-fc04-4a55-8927-97ff89179b97 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed6ee10954043d2b49acbc3695a42f0)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:29.748139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe241a-fc04-4a55-8927-97ff89179b97 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:29.750069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 166/332] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:29 2022] GET /identity/v3/users/3ed6ee10954043d2b49acbc3695a42f0 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:29.756012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da841c0-9c41-4927-8ae9-bd26a3051e78 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:29.766976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da841c0-9c41-4927-8ae9-bd26a3051e78 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:29.771817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505ffe6-3413-499d-a4a0-cfcfa47994c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:29.772746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505ffe6-3413-499d-a4a0-cfcfa47994c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:29.773027 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505ffe6-3413-499d-a4a0-cfcfa47994c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:29.773303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505ffe6-3413-499d-a4a0-cfcfa47994c0 admin admin] PATH_INFO: `/v3/system/users/3ed6ee10954043d2b49acbc3695a42f0/roles/95dbcc27f28a4639b5489fe8b030cba3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:29.775019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505ffe6-3413-499d-a4a0-cfcfa47994c0 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3ed6ee10954043d2b49acbc3695a42f0, role_id=95dbcc27f28a4639b5489fe8b030cba3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:29.776121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-5505ffe6-3413-499d-a4a0-cfcfa47994c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:29.776121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:29.776121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:29.777654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505ffe6-3413-499d-a4a0-cfcfa47994c0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:29.788866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 167/333] 10.222.0.48 () {58 vars in 1355 bytes} [Thu Jan 27 16:36:29 2022] PUT /identity/v3/system/users/3ed6ee10954043d2b49acbc3695a42f0/roles/95dbcc27f28a4639b5489fe8b030cba3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:32.656946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77d095-7487-4020-aff9-1fb8e6c38faa None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.657970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77d095-7487-4020-aff9-1fb8e6c38faa None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.658456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77d095-7487-4020-aff9-1fb8e6c38faa None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.668789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 167/334] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:32.675619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbc697-4da4-4559-82dd-209600a95d4d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.676584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbc697-4da4-4559-82dd-209600a95d4d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.677096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbc697-4da4-4559-82dd-209600a95d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.696648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6afbc697-4da4-4559-82dd-209600a95d4d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:32.698236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6afbc697-4da4-4559-82dd-209600a95d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:32.707022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 168/335] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:32.737302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77d095-7487-4020-aff9-1fb8e6c38faa None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:32.750342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77d095-7487-4020-aff9-1fb8e6c38faa None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:32.756577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b799d5-52d1-4d11-b17f-26abb673f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:32.757662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b799d5-52d1-4d11-b17f-26abb673f6da admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.758214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b799d5-52d1-4d11-b17f-26abb673f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.758696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b799d5-52d1-4d11-b17f-26abb673f6da admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.774717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566b79-9b3e-46ea-bafe-bd20cb1ded88 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.775324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566b79-9b3e-46ea-bafe-bd20cb1ded88 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.775830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60566b79-9b3e-46ea-bafe-bd20cb1ded88 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.778793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 169/336] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:32.780592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b799d5-52d1-4d11-b17f-26abb673f6da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:32.784069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e693a-ad10-4f9c-9915-0e7b4e556b2e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.784578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e693a-ad10-4f9c-9915-0e7b4e556b2e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.785054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e693a-ad10-4f9c-9915-0e7b4e556b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.797826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-34b799d5-52d1-4d11-b17f-26abb673f6da admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:32.809373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 168/337] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:32.813511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b799d5-52d1-4d11-b17f-26abb673f6da admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:32.815022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a78e693a-ad10-4f9c-9915-0e7b4e556b2e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:32.816779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a78e693a-ad10-4f9c-9915-0e7b4e556b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:32.828874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b799d5-52d1-4d11-b17f-26abb673f6da admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:32.835991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 170/338] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:32.838025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058970dd-bedb-493f-b208-22c2ae48fcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:32.838912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058970dd-bedb-493f-b208-22c2ae48fcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.839393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058970dd-bedb-493f-b208-22c2ae48fcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.840495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058970dd-bedb-493f-b208-22c2ae48fcf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.841463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058970dd-bedb-493f-b208-22c2ae48fcf5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:32.841985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058970dd-bedb-493f-b208-22c2ae48fcf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:32.843798 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058970dd-bedb-493f-b208-22c2ae48fcf5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:32.854366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 169/339] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:32.860861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e693a-ad10-4f9c-9915-0e7b4e556b2e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:32.870768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e693a-ad10-4f9c-9915-0e7b4e556b2e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:32.876303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb203e6f-2850-4520-9344-c803f1f59010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:32.877193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb203e6f-2850-4520-9344-c803f1f59010 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.877679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb203e6f-2850-4520-9344-c803f1f59010 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.878157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb203e6f-2850-4520-9344-c803f1f59010 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.879755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058970dd-bedb-493f-b208-22c2ae48fcf5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:32.894923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058970dd-bedb-493f-b208-22c2ae48fcf5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:32.900591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb203e6f-2850-4520-9344-c803f1f59010 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:32.903144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb203e6f-2850-4520-9344-c803f1f59010 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:32.909905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8e9e1-0933-4779-9ef4-1d52e1353ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:32.911103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8e9e1-0933-4779-9ef4-1d52e1353ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.913034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8e9e1-0933-4779-9ef4-1d52e1353ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.913637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8e9e1-0933-4779-9ef4-1d52e1353ab8 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.918121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 171/340] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:36:32.923899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb203e6f-2850-4520-9344-c803f1f59010 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:32.934083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb203e6f-2850-4520-9344-c803f1f59010 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:32.938341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8e9e1-0933-4779-9ef4-1d52e1353ab8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:32.938885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a726c-511a-48be-9484-340afac7eb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:32.939766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a726c-511a-48be-9484-340afac7eb70 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.940049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a726c-511a-48be-9484-340afac7eb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.940328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a726c-511a-48be-9484-340afac7eb70 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.941529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a726c-511a-48be-9484-340afac7eb70 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:32.943551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a726c-511a-48be-9484-340afac7eb70 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:32.951597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 172/341] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:32 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:32.951784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-c7c8e9e1-0933-4779-9ef4-1d52e1353ab8 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jan 27 16:36:32.955598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 170/342] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:32.955789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a726c-511a-48be-9484-340afac7eb70 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:32.961342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8e9e1-0933-4779-9ef4-1d52e1353ab8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:32.972049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a726c-511a-48be-9484-340afac7eb70 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:32.980164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8e9e1-0933-4779-9ef4-1d52e1353ab8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:32.982494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b6f1a-96cb-4b9d-b1af-9037b3ea5632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:32.983349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6f1a-96cb-4b9d-b1af-9037b3ea5632 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.983645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6f1a-96cb-4b9d-b1af-9037b3ea5632 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.983920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b6f1a-96cb-4b9d-b1af-9037b3ea5632 admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.991991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e47d1-fdee-45e0-a8b9-2b3ead4a306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:32.992654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e47d1-fdee-45e0-a8b9-2b3ead4a306d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:32.992927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e47d1-fdee-45e0-a8b9-2b3ead4a306d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:32.993199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e47d1-fdee-45e0-a8b9-2b3ead4a306d admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:32.993958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e47d1-fdee-45e0-a8b9-2b3ead4a306d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:32.994254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e47d1-fdee-45e0-a8b9-2b3ead4a306d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:32.996424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e47d1-fdee-45e0-a8b9-2b3ead4a306d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.000742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b6f1a-96cb-4b9d-b1af-9037b3ea5632 admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.001788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-140b6f1a-96cb-4b9d-b1af-9037b3ea5632 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:33.001788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:33.001788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:33.002957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b6f1a-96cb-4b9d-b1af-9037b3ea5632 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.004657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 173/343] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:32 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.010232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b6f1a-96cb-4b9d-b1af-9037b3ea5632 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.012372 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 171/344] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.017664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e47d1-fdee-45e0-a8b9-2b3ead4a306d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.021930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b6f1a-96cb-4b9d-b1af-9037b3ea5632 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.026366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025190-1a88-4a83-abbb-2000d345ec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.027042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025190-1a88-4a83-abbb-2000d345ec4f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.027334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025190-1a88-4a83-abbb-2000d345ec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.027861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a025190-1a88-4a83-abbb-2000d345ec4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.028854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a025190-1a88-4a83-abbb-2000d345ec4f admin admin] RBAC: Adding query filter params (group.id=9119b3408d8849be8b2d15acf71e093c, role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=9fb3d018836e4765a6346dd80809dc63) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:33.029167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a025190-1a88-4a83-abbb-2000d345ec4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.032307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a025190-1a88-4a83-abbb-2000d345ec4f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.039746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 174/345] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/role_assignments?group.id=9119b3408d8849be8b2d15acf71e093c&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:33.042250 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e47d1-fdee-45e0-a8b9-2b3ead4a306d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.050286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e6f43-e2c0-4a3f-ae60-6cd7a9fc1357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.051109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6f43-e2c0-4a3f-ae60-6cd7a9fc1357 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.051393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6f43-e2c0-4a3f-ae60-6cd7a9fc1357 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.051707 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e6f43-e2c0-4a3f-ae60-6cd7a9fc1357 admin admin] PATH_INFO: `/v3/users/3ed6ee10954043d2b49acbc3695a42f0` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.056581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6f43-e2c0-4a3f-ae60-6cd7a9fc1357 admin admin] RBAC: Authorizing `identity:get_user(user_id=3ed6ee10954043d2b49acbc3695a42f0)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.059249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e6f43-e2c0-4a3f-ae60-6cd7a9fc1357 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.061269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 172/346] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/users/3ed6ee10954043d2b49acbc3695a42f0 => generated 293 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:33.067038 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025190-1a88-4a83-abbb-2000d345ec4f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.082373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a025190-1a88-4a83-abbb-2000d345ec4f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.086819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb62ee5-6add-4072-a88f-c7af67a64f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.087477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb62ee5-6add-4072-a88f-c7af67a64f58 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.087779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb62ee5-6add-4072-a88f-c7af67a64f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.088056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb62ee5-6add-4072-a88f-c7af67a64f58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.088899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb62ee5-6add-4072-a88f-c7af67a64f58 admin admin] RBAC: Adding query filter params (role.id=95dbcc27f28a4639b5489fe8b030cba3, user.id=3ed6ee10954043d2b49acbc3695a42f0, scope.system=all) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:33.089209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb62ee5-6add-4072-a88f-c7af67a64f58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.099628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb62ee5-6add-4072-a88f-c7af67a64f58 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.109452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c2419-b9bb-4f62-917e-21c087cd5d46 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.109721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c2419-b9bb-4f62-917e-21c087cd5d46 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.110003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c2419-b9bb-4f62-917e-21c087cd5d46 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.111926 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 173/347] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:33.119477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 175/348] 10.222.0.48 () {56 vars in 1329 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/role_assignments?user.id=3ed6ee10954043d2b49acbc3695a42f0&scope.system=all&role.id=95dbcc27f28a4639b5489fe8b030cba3 => generated 510 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.121577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81749f31-fa03-41df-ab38-5464ee82c588 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.121874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81749f31-fa03-41df-ab38-5464ee82c588 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.122157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81749f31-fa03-41df-ab38-5464ee82c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.148870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-81749f31-fa03-41df-ab38-5464ee82c588 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:33.150273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-81749f31-fa03-41df-ab38-5464ee82c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:33.159200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 174/349] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:33.205894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb62ee5-6add-4072-a88f-c7af67a64f58 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.216822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb62ee5-6add-4072-a88f-c7af67a64f58 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.228194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0d23f-9305-4aa6-bb55-f414bd8a491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.229018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0d23f-9305-4aa6-bb55-f414bd8a491d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.229308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0d23f-9305-4aa6-bb55-f414bd8a491d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.229584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0d23f-9305-4aa6-bb55-f414bd8a491d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.249852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0d23f-9305-4aa6-bb55-f414bd8a491d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:33.250173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc838b-2496-464b-a642-84621ca14a29 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.250173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc838b-2496-464b-a642-84621ca14a29 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.250173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc838b-2496-464b-a642-84621ca14a29 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.250854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 175/350] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:33.254076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-88f0d23f-9305-4aa6-bb55-f414bd8a491d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:33.255265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 176/351] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:33.257442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dde9f-7a7f-41d1-bca7-41ca6d610819 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.257999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dde9f-7a7f-41d1-bca7-41ca6d610819 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.258480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dde9f-7a7f-41d1-bca7-41ca6d610819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.263608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0d23f-9305-4aa6-bb55-f414bd8a491d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.284346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0d23f-9305-4aa6-bb55-f414bd8a491d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.293273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-747dde9f-7a7f-41d1-bca7-41ca6d610819 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:33.294108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6467b19-9095-4e43-936b-9d98d773ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.294599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-747dde9f-7a7f-41d1-bca7-41ca6d610819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:33.294843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6467b19-9095-4e43-936b-9d98d773ab60 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.295135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6467b19-9095-4e43-936b-9d98d773ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.295418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6467b19-9095-4e43-936b-9d98d773ab60 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.296225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6467b19-9095-4e43-936b-9d98d773ab60 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:33.296536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6467b19-9095-4e43-936b-9d98d773ab60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.298243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6467b19-9095-4e43-936b-9d98d773ab60 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.305262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 176/352] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:33.308752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 177/353] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:33.314205 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dde9f-7a7f-41d1-bca7-41ca6d610819 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.330148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dde9f-7a7f-41d1-bca7-41ca6d610819 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.334684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e85d7-4734-4fbf-8d34-51b6bcea3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.335355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e85d7-4734-4fbf-8d34-51b6bcea3c0c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.335676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e85d7-4734-4fbf-8d34-51b6bcea3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.335952 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e85d7-4734-4fbf-8d34-51b6bcea3c0c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.351704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e85d7-4734-4fbf-8d34-51b6bcea3c0c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.352724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6467b19-9095-4e43-936b-9d98d773ab60 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.353710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e85d7-4734-4fbf-8d34-51b6bcea3c0c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.365335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6467b19-9095-4e43-936b-9d98d773ab60 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.369886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 177/354] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:33.376378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e85d7-4734-4fbf-8d34-51b6bcea3c0c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.380012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddea0c-71de-4a77-a44e-73427e6c3a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.381130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddea0c-71de-4a77-a44e-73427e6c3a77 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.381340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddea0c-71de-4a77-a44e-73427e6c3a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.381548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddea0c-71de-4a77-a44e-73427e6c3a77 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.386069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e85d7-4734-4fbf-8d34-51b6bcea3c0c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.391550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1fcd9-d433-4618-a84d-b6c1f4bfc384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.392456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1fcd9-d433-4618-a84d-b6c1f4bfc384 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.392736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1fcd9-d433-4618-a84d-b6c1f4bfc384 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.393012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1fcd9-d433-4618-a84d-b6c1f4bfc384 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.394240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1fcd9-d433-4618-a84d-b6c1f4bfc384 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.400782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1fcd9-d433-4618-a84d-b6c1f4bfc384 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.403866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 178/355] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.410479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddea0c-71de-4a77-a44e-73427e6c3a77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:33.418335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-69ddea0c-71de-4a77-a44e-73427e6c3a77 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:33.424682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 178/356] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:33.425702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1fcd9-d433-4618-a84d-b6c1f4bfc384 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.430763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddea0c-71de-4a77-a44e-73427e6c3a77 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.444719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddea0c-71de-4a77-a44e-73427e6c3a77 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.447470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1fcd9-d433-4618-a84d-b6c1f4bfc384 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.452991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a232d32-b5b5-4818-a06e-a8c60950c820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.453864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a232d32-b5b5-4818-a06e-a8c60950c820 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.454143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a232d32-b5b5-4818-a06e-a8c60950c820 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.454414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a232d32-b5b5-4818-a06e-a8c60950c820 admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.458106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f076c9a-8c2f-4744-8bdd-ef59aeee21ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.458767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f076c9a-8c2f-4744-8bdd-ef59aeee21ae admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.459045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f076c9a-8c2f-4744-8bdd-ef59aeee21ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.459331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f076c9a-8c2f-4744-8bdd-ef59aeee21ae admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.460108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f076c9a-8c2f-4744-8bdd-ef59aeee21ae admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:33.460411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f076c9a-8c2f-4744-8bdd-ef59aeee21ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.462014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f076c9a-8c2f-4744-8bdd-ef59aeee21ae admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.465585 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a232d32-b5b5-4818-a06e-a8c60950c820 admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.471596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-4a232d32-b5b5-4818-a06e-a8c60950c820 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:33.471596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:36:33.471596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:36:33.471596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a232d32-b5b5-4818-a06e-a8c60950c820 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.471596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 179/357] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.476269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a232d32-b5b5-4818-a06e-a8c60950c820 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.486761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 179/358] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.492534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f076c9a-8c2f-4744-8bdd-ef59aeee21ae admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.501184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a232d32-b5b5-4818-a06e-a8c60950c820 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.511318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dca47-c5b6-4b55-be49-a2e169c080b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.512284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dca47-c5b6-4b55-be49-a2e169c080b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.512629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dca47-c5b6-4b55-be49-a2e169c080b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.512904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dca47-c5b6-4b55-be49-a2e169c080b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.513753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dca47-c5b6-4b55-be49-a2e169c080b0 admin admin] RBAC: Adding query filter params (group.id=9119b3408d8849be8b2d15acf71e093c, role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=63e316d140ed4e29a50b866b5c7569f1) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:33.514064 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dca47-c5b6-4b55-be49-a2e169c080b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.515953 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dca47-c5b6-4b55-be49-a2e169c080b0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.520205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f076c9a-8c2f-4744-8bdd-ef59aeee21ae admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.524590 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76c26d-7c71-4d88-8367-a69d87630725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.525231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c26d-7c71-4d88-8367-a69d87630725 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.525513 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c26d-7c71-4d88-8367-a69d87630725 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.525789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76c26d-7c71-4d88-8367-a69d87630725 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.536736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 180/359] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/role_assignments?group.id=9119b3408d8849be8b2d15acf71e093c&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 260 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.541487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76c26d-7c71-4d88-8367-a69d87630725 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.549341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76c26d-7c71-4d88-8367-a69d87630725 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.568385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 180/360] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:36:33.574596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dca47-c5b6-4b55-be49-a2e169c080b0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.597929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dca47-c5b6-4b55-be49-a2e169c080b0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.609084 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc4906-99ee-4538-8137-880030755de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.609980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4906-99ee-4538-8137-880030755de7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.610268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4906-99ee-4538-8137-880030755de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.610544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc4906-99ee-4538-8137-880030755de7 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.616631 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc4906-99ee-4538-8137-880030755de7 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.618753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc4906-99ee-4538-8137-880030755de7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.620723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 181/361] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.627042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76c26d-7c71-4d88-8367-a69d87630725 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.642097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76c26d-7c71-4d88-8367-a69d87630725 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.646635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038037a-c6bb-4526-b46f-ea6f4969816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.647504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038037a-c6bb-4526-b46f-ea6f4969816b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.647817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038037a-c6bb-4526-b46f-ea6f4969816b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.648092 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038037a-c6bb-4526-b46f-ea6f4969816b admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.649340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038037a-c6bb-4526-b46f-ea6f4969816b admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.651307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038037a-c6bb-4526-b46f-ea6f4969816b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.657677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 181/362] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.663899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc4906-99ee-4538-8137-880030755de7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.676886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc4906-99ee-4538-8137-880030755de7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.684453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762baa4d-cdb7-4913-8b27-9ead4c86fd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.685345 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762baa4d-cdb7-4913-8b27-9ead4c86fd6f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.685625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762baa4d-cdb7-4913-8b27-9ead4c86fd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.685896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762baa4d-cdb7-4913-8b27-9ead4c86fd6f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.686755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762baa4d-cdb7-4913-8b27-9ead4c86fd6f admin admin] RBAC: Adding query filter params (group.id=9119b3408d8849be8b2d15acf71e093c, role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=9fb3d018836e4765a6346dd80809dc63) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:33.687065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762baa4d-cdb7-4913-8b27-9ead4c86fd6f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:33.688986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762baa4d-cdb7-4913-8b27-9ead4c86fd6f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:33.696239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 182/363] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/role_assignments?group.id=9119b3408d8849be8b2d15acf71e093c&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:33.873897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe80db9-923a-49f3-8a7a-3a9cbc91b627 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.874544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe80db9-923a-49f3-8a7a-3a9cbc91b627 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.874544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe80db9-923a-49f3-8a7a-3a9cbc91b627 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.876507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 182/364] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:33.882949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b54ac-ecb4-41bd-a487-b26c8f5163bc None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.883242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b54ac-ecb4-41bd-a487-b26c8f5163bc None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.883505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b54ac-ecb4-41bd-a487-b26c8f5163bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.904701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e90b54ac-ecb4-41bd-a487-b26c8f5163bc None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:33.905900 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e90b54ac-ecb4-41bd-a487-b26c8f5163bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:33.913972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 183/365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:33.938743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe80db9-923a-49f3-8a7a-3a9cbc91b627 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:33.957197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe80db9-923a-49f3-8a7a-3a9cbc91b627 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:33.967142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacb261-9d34-4c52-8bc7-19d82fcb1114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:33.967993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb261-9d34-4c52-8bc7-19d82fcb1114 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:33.968280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb261-9d34-4c52-8bc7-19d82fcb1114 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:33.968559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacb261-9d34-4c52-8bc7-19d82fcb1114 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:33.989209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacb261-9d34-4c52-8bc7-19d82fcb1114 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:33.997132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-bcacb261-9d34-4c52-8bc7-19d82fcb1114 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:33.998733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 183/366] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:34.007625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b54ac-ecb4-41bd-a487-b26c8f5163bc None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.016980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b54ac-ecb4-41bd-a487-b26c8f5163bc None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.026096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08f18-0089-449e-bdc0-ddebb5e3e1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.027164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08f18-0089-449e-bdc0-ddebb5e3e1ea admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.027705 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08f18-0089-449e-bdc0-ddebb5e3e1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.028229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e08f18-0089-449e-bdc0-ddebb5e3e1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.029197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08f18-0089-449e-bdc0-ddebb5e3e1ea admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:34.029783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08f18-0089-449e-bdc0-ddebb5e3e1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.031932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e08f18-0089-449e-bdc0-ddebb5e3e1ea admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.047198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 184/367] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:34.052478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacb261-9d34-4c52-8bc7-19d82fcb1114 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.069434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacb261-9d34-4c52-8bc7-19d82fcb1114 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.079155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c32ad9-fbfb-468a-a602-3b5be1f457ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.079848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c32ad9-fbfb-468a-a602-3b5be1f457ce admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.080135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c32ad9-fbfb-468a-a602-3b5be1f457ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.080416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c32ad9-fbfb-468a-a602-3b5be1f457ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.093340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c32ad9-fbfb-468a-a602-3b5be1f457ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.095253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c32ad9-fbfb-468a-a602-3b5be1f457ce admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.106157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 184/368] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:34.112004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08f18-0089-449e-bdc0-ddebb5e3e1ea admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.129007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e08f18-0089-449e-bdc0-ddebb5e3e1ea admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.145225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520dd34-68c6-4bb7-a822-087a0789bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.146102 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520dd34-68c6-4bb7-a822-087a0789bdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.146380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520dd34-68c6-4bb7-a822-087a0789bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.146652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520dd34-68c6-4bb7-a822-087a0789bdc6 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.152950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520dd34-68c6-4bb7-a822-087a0789bdc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.155095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520dd34-68c6-4bb7-a822-087a0789bdc6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.157476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 185/369] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:34.162479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c32ad9-fbfb-468a-a602-3b5be1f457ce admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.171918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c32ad9-fbfb-468a-a602-3b5be1f457ce admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.184398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38f0ce-91e5-47e9-af5c-089396054445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.185280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38f0ce-91e5-47e9-af5c-089396054445 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.185563 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38f0ce-91e5-47e9-af5c-089396054445 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.185838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38f0ce-91e5-47e9-af5c-089396054445 admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.188298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38f0ce-91e5-47e9-af5c-089396054445 admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.190216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38f0ce-91e5-47e9-af5c-089396054445 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.192166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 185/370] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:34.198184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520dd34-68c6-4bb7-a822-087a0789bdc6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.211045 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520dd34-68c6-4bb7-a822-087a0789bdc6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.219702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af536642-e05c-4ceb-a00d-0ecae10083d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.220369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536642-e05c-4ceb-a00d-0ecae10083d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.220650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536642-e05c-4ceb-a00d-0ecae10083d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.220924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af536642-e05c-4ceb-a00d-0ecae10083d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.221775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af536642-e05c-4ceb-a00d-0ecae10083d0 admin admin] RBAC: Adding query filter params (group.id=9119b3408d8849be8b2d15acf71e093c, role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=63e316d140ed4e29a50b866b5c7569f1) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:34.222088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af536642-e05c-4ceb-a00d-0ecae10083d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.223971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af536642-e05c-4ceb-a00d-0ecae10083d0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.236253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 186/371] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/role_assignments?group.id=9119b3408d8849be8b2d15acf71e093c&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:34.617346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff529b-dbed-43c8-9c03-65f8c761a1b2 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.617706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff529b-dbed-43c8-9c03-65f8c761a1b2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.617920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff529b-dbed-43c8-9c03-65f8c761a1b2 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.619729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 186/372] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:34.626221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c7a40-b0b2-442e-955d-d3fb59e171db None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.626515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c7a40-b0b2-442e-955d-d3fb59e171db None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.626767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c7a40-b0b2-442e-955d-d3fb59e171db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.648608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-616c7a40-b0b2-442e-955d-d3fb59e171db None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:34.649788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-616c7a40-b0b2-442e-955d-d3fb59e171db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:34.662913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 187/373] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:34.713826 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff529b-dbed-43c8-9c03-65f8c761a1b2 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.725731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff529b-dbed-43c8-9c03-65f8c761a1b2 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.729967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c46512-f77c-44ff-8018-7aa8abc71275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.731644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c46512-f77c-44ff-8018-7aa8abc71275 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.732147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c46512-f77c-44ff-8018-7aa8abc71275 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.732503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c46512-f77c-44ff-8018-7aa8abc71275 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.750100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c46512-f77c-44ff-8018-7aa8abc71275 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:34.756959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c7c46512-f77c-44ff-8018-7aa8abc71275 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:34.758458 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 187/374] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:34.764590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c7a40-b0b2-442e-955d-d3fb59e171db None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.776440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c7a40-b0b2-442e-955d-d3fb59e171db None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.785134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1facb23-a834-48d1-8e5a-08cb1d93f3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.785841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1facb23-a834-48d1-8e5a-08cb1d93f3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.786122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1facb23-a834-48d1-8e5a-08cb1d93f3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.786399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1facb23-a834-48d1-8e5a-08cb1d93f3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.787189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1facb23-a834-48d1-8e5a-08cb1d93f3e1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:34.787501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1facb23-a834-48d1-8e5a-08cb1d93f3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.789153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1facb23-a834-48d1-8e5a-08cb1d93f3e1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.805851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 188/375] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:34.811602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c46512-f77c-44ff-8018-7aa8abc71275 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.825305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c46512-f77c-44ff-8018-7aa8abc71275 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.829734 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac12105-0085-41c8-9202-285355010645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.830373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac12105-0085-41c8-9202-285355010645 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.830653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac12105-0085-41c8-9202-285355010645 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.830930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac12105-0085-41c8-9202-285355010645 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.847821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac12105-0085-41c8-9202-285355010645 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.849551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac12105-0085-41c8-9202-285355010645 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.861890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 188/376] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:34.867156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1facb23-a834-48d1-8e5a-08cb1d93f3e1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.880639 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1facb23-a834-48d1-8e5a-08cb1d93f3e1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.887984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03a207-e5a4-4e5a-b06a-baaf6a524a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.888856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03a207-e5a4-4e5a-b06a-baaf6a524a72 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.889147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03a207-e5a4-4e5a-b06a-baaf6a524a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.889428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03a207-e5a4-4e5a-b06a-baaf6a524a72 admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.895402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03a207-e5a4-4e5a-b06a-baaf6a524a72 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e1134f718c7471d948ccfe1ca59674e)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.897277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03a207-e5a4-4e5a-b06a-baaf6a524a72 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.899396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 189/377] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e => generated 344 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:34.905188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac12105-0085-41c8-9202-285355010645 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.924594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac12105-0085-41c8-9202-285355010645 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.929802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dddc4b-a302-47cb-9845-408cf578cb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.930669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dddc4b-a302-47cb-9845-408cf578cb65 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.930947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dddc4b-a302-47cb-9845-408cf578cb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.931227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dddc4b-a302-47cb-9845-408cf578cb65 admin admin] PATH_INFO: `/v3/groups/89b38cb2d8be42c0abbd5b50e9265923` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.939210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dddc4b-a302-47cb-9845-408cf578cb65 admin admin] RBAC: Authorizing `identity:get_group(group_id=89b38cb2d8be42c0abbd5b50e9265923)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.941526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dddc4b-a302-47cb-9845-408cf578cb65 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.944045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 189/378] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/groups/89b38cb2d8be42c0abbd5b50e9265923 => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:34.950554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03a207-e5a4-4e5a-b06a-baaf6a524a72 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:34.968789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03a207-e5a4-4e5a-b06a-baaf6a524a72 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:34.979664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef76f0-1afd-43f7-b046-d9ef56ece661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:34.982564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef76f0-1afd-43f7-b046-d9ef56ece661 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:34.982564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef76f0-1afd-43f7-b046-d9ef56ece661 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:34.982564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef76f0-1afd-43f7-b046-d9ef56ece661 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:34.982564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef76f0-1afd-43f7-b046-d9ef56ece661 admin admin] RBAC: Adding query filter params (group.id=89b38cb2d8be42c0abbd5b50e9265923, role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=0e1134f718c7471d948ccfe1ca59674e) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:34.982564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef76f0-1afd-43f7-b046-d9ef56ece661 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:34.984151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef76f0-1afd-43f7-b046-d9ef56ece661 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:34.996661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 190/379] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:34 2022] GET /identity/v3/role_assignments?group.id=89b38cb2d8be42c0abbd5b50e9265923&scope.project.id=0e1134f718c7471d948ccfe1ca59674e&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:36.148790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12157150-ea28-4adf-aa32-fb84010f3f25 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.149812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12157150-ea28-4adf-aa32-fb84010f3f25 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.150304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12157150-ea28-4adf-aa32-fb84010f3f25 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.152662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 190/380] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:36.158156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050189af-fbc4-4dd4-9df9-81648bdb1d1d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.158591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050189af-fbc4-4dd4-9df9-81648bdb1d1d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.158685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050189af-fbc4-4dd4-9df9-81648bdb1d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.184661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-050189af-fbc4-4dd4-9df9-81648bdb1d1d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:36.185988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-050189af-fbc4-4dd4-9df9-81648bdb1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:36.193997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 191/381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:36.218300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12157150-ea28-4adf-aa32-fb84010f3f25 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:36.233225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12157150-ea28-4adf-aa32-fb84010f3f25 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:36.237850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472632a-c63e-4498-b7f7-5d521e3c8a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:36.238647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472632a-c63e-4498-b7f7-5d521e3c8a9b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.238964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472632a-c63e-4498-b7f7-5d521e3c8a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.239265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472632a-c63e-4498-b7f7-5d521e3c8a9b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.253131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472632a-c63e-4498-b7f7-5d521e3c8a9b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:36.260089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c472632a-c63e-4498-b7f7-5d521e3c8a9b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:36.261294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 191/382] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:36.267796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050189af-fbc4-4dd4-9df9-81648bdb1d1d None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:36.281406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050189af-fbc4-4dd4-9df9-81648bdb1d1d None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:36.286550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46bead-b78f-4cf9-b7e6-d67d2f9855aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:36.287228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46bead-b78f-4cf9-b7e6-d67d2f9855aa admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.287511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46bead-b78f-4cf9-b7e6-d67d2f9855aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.287813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46bead-b78f-4cf9-b7e6-d67d2f9855aa admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.288586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46bead-b78f-4cf9-b7e6-d67d2f9855aa admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:36.288892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46bead-b78f-4cf9-b7e6-d67d2f9855aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:36.290493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46bead-b78f-4cf9-b7e6-d67d2f9855aa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:36.303654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 192/383] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:36.309754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472632a-c63e-4498-b7f7-5d521e3c8a9b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:36.319613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472632a-c63e-4498-b7f7-5d521e3c8a9b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:36.328343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131d8ca-d637-4ea1-8fd9-eec98d79fffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:36.329199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131d8ca-d637-4ea1-8fd9-eec98d79fffb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.329482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131d8ca-d637-4ea1-8fd9-eec98d79fffb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.329760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3131d8ca-d637-4ea1-8fd9-eec98d79fffb admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.330976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131d8ca-d637-4ea1-8fd9-eec98d79fffb admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:36.336632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3131d8ca-d637-4ea1-8fd9-eec98d79fffb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:36.338309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 192/384] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:36 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:36.344598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46bead-b78f-4cf9-b7e6-d67d2f9855aa admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:36.354914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46bead-b78f-4cf9-b7e6-d67d2f9855aa admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:36.363708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec234b3-fc50-4443-9cdb-5f7f3404734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:36.364576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec234b3-fc50-4443-9cdb-5f7f3404734b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.364857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec234b3-fc50-4443-9cdb-5f7f3404734b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.365136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec234b3-fc50-4443-9cdb-5f7f3404734b admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.366368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec234b3-fc50-4443-9cdb-5f7f3404734b admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:36.368457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec234b3-fc50-4443-9cdb-5f7f3404734b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:36.371497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 193/385] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:36 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:36.376225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131d8ca-d637-4ea1-8fd9-eec98d79fffb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:36.386664 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3131d8ca-d637-4ea1-8fd9-eec98d79fffb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:36.397709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009dbb6-68e1-47dd-828b-66a9ce929162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:36.398609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009dbb6-68e1-47dd-828b-66a9ce929162 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.398939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009dbb6-68e1-47dd-828b-66a9ce929162 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.399161 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009dbb6-68e1-47dd-828b-66a9ce929162 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63/groups/9119b3408d8849be8b2d15acf71e093c/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.401230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009dbb6-68e1-47dd-828b-66a9ce929162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb3d018836e4765a6346dd80809dc63, group_id=9119b3408d8849be8b2d15acf71e093c, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:36.404575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009dbb6-68e1-47dd-828b-66a9ce929162 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:36.425390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 193/386] 10.222.0.48 () {58 vars in 1463 bytes} [Thu Jan 27 16:36:36 2022] PUT /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63/groups/9119b3408d8849be8b2d15acf71e093c/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:36.817056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94aa12-2882-4266-9664-9805fc19a947 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.817444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94aa12-2882-4266-9664-9805fc19a947 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.817615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94aa12-2882-4266-9664-9805fc19a947 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.819387 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 194/387] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:36.825956 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2deaf-a289-416f-a856-65e34a988721 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.826240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2deaf-a289-416f-a856-65e34a988721 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.826526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2deaf-a289-416f-a856-65e34a988721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.848012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-8aa2deaf-a289-416f-a856-65e34a988721 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:36.849219 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8aa2deaf-a289-416f-a856-65e34a988721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:36.918620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 194/388] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:36.955732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2deaf-a289-416f-a856-65e34a988721 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:36.956557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa05d4-bb13-4021-903b-2c6da53343bb None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.957067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa05d4-bb13-4021-903b-2c6da53343bb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.957536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa05d4-bb13-4021-903b-2c6da53343bb None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.959803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 195/389] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:36.965037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2deaf-a289-416f-a856-65e34a988721 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:36.966255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba4a7b-0abb-4042-a3e0-9a2b7d87066e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.966547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba4a7b-0abb-4042-a3e0-9a2b7d87066e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.966829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba4a7b-0abb-4042-a3e0-9a2b7d87066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.969864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc961d-ed8d-44ee-9f07-c2589a6cd649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:36.970657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc961d-ed8d-44ee-9f07-c2589a6cd649 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:36.970937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc961d-ed8d-44ee-9f07-c2589a6cd649 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:36.971267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc961d-ed8d-44ee-9f07-c2589a6cd649 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:36.993770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc961d-ed8d-44ee-9f07-c2589a6cd649 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:37.000709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ddba4a7b-0abb-4042-a3e0-9a2b7d87066e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:37.001948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ddba4a7b-0abb-4042-a3e0-9a2b7d87066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:37.002432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-01cc961d-ed8d-44ee-9f07-c2589a6cd649 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:37.004372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 195/390] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:37.010301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc961d-ed8d-44ee-9f07-c2589a6cd649 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.013667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 196/391] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:37.027177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc961d-ed8d-44ee-9f07-c2589a6cd649 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.036291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fdf13-fd34-404a-a209-e838f31fe401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.037022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fdf13-fd34-404a-a209-e838f31fe401 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.037303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fdf13-fd34-404a-a209-e838f31fe401 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.037633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fdf13-fd34-404a-a209-e838f31fe401 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.038400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fdf13-fd34-404a-a209-e838f31fe401 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:37.038707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fdf13-fd34-404a-a209-e838f31fe401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.040441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fdf13-fd34-404a-a209-e838f31fe401 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.045468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba4a7b-0abb-4042-a3e0-9a2b7d87066e None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.061386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 196/392] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:37.063537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba4a7b-0abb-4042-a3e0-9a2b7d87066e None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.067586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fdf13-fd34-404a-a209-e838f31fe401 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.073988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33c54c-db28-48ef-a171-8a598abf704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.075057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c54c-db28-48ef-a171-8a598abf704a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.075445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c54c-db28-48ef-a171-8a598abf704a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.075757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33c54c-db28-48ef-a171-8a598abf704a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.085582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fdf13-fd34-404a-a209-e838f31fe401 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.092815 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b360d-f975-4f34-897e-a96fab229bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.093663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b360d-f975-4f34-897e-a96fab229bfe admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.093940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b360d-f975-4f34-897e-a96fab229bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.094209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b360d-f975-4f34-897e-a96fab229bfe admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.098467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b360d-f975-4f34-897e-a96fab229bfe admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.100386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b360d-f975-4f34-897e-a96fab229bfe admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.102165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 197/393] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:37.102852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33c54c-db28-48ef-a171-8a598abf704a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:37.110762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-6e33c54c-db28-48ef-a171-8a598abf704a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:37.112452 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b360d-f975-4f34-897e-a96fab229bfe admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.117574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 197/394] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:37.126896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b360d-f975-4f34-897e-a96fab229bfe admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.128847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33c54c-db28-48ef-a171-8a598abf704a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.134275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fe08c-36e5-4c99-b35d-2cc742a62a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.135183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fe08c-36e5-4c99-b35d-2cc742a62a0e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.135462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fe08c-36e5-4c99-b35d-2cc742a62a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.135825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6fe08c-36e5-4c99-b35d-2cc742a62a0e admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.139485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33c54c-db28-48ef-a171-8a598abf704a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.140383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fe08c-36e5-4c99-b35d-2cc742a62a0e admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.142608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6fe08c-36e5-4c99-b35d-2cc742a62a0e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.144795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 198/395] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:37.145718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fff8e-5395-49c1-8481-b635acef146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.146391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fff8e-5395-49c1-8481-b635acef146f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.146671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fff8e-5395-49c1-8481-b635acef146f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.146949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fff8e-5395-49c1-8481-b635acef146f admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.147748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fff8e-5395-49c1-8481-b635acef146f admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:37.148055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fff8e-5395-49c1-8481-b635acef146f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.149908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fff8e-5395-49c1-8481-b635acef146f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.150661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fe08c-36e5-4c99-b35d-2cc742a62a0e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.162128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6fe08c-36e5-4c99-b35d-2cc742a62a0e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.162887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 198/396] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:37.169762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fff8e-5395-49c1-8481-b635acef146f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.180004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fff8e-5395-49c1-8481-b635acef146f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.185690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f533b7b-f6c6-4245-be8d-a334835a9a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.186331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98954acc-00ad-4962-ae29-73e7532d1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.186591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f533b7b-f6c6-4245-be8d-a334835a9a2f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.186870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f533b7b-f6c6-4245-be8d-a334835a9a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.187142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98954acc-00ad-4962-ae29-73e7532d1bca admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.187396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f533b7b-f6c6-4245-be8d-a334835a9a2f admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.187598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98954acc-00ad-4962-ae29-73e7532d1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.187745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98954acc-00ad-4962-ae29-73e7532d1bca admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63/groups/9119b3408d8849be8b2d15acf71e093c/roles/27ceba94bdd34cc790ee9e7b8fb06d57` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.188516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f533b7b-f6c6-4245-be8d-a334835a9a2f admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.190524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f533b7b-f6c6-4245-be8d-a334835a9a2f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.194573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 199/397] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:37.194961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98954acc-00ad-4962-ae29-73e7532d1bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb3d018836e4765a6346dd80809dc63, group_id=9119b3408d8849be8b2d15acf71e093c, role_id=27ceba94bdd34cc790ee9e7b8fb06d57)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.197637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98954acc-00ad-4962-ae29-73e7532d1bca admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.208800 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f533b7b-f6c6-4245-be8d-a334835a9a2f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.220958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 199/398] 10.222.0.48 () {58 vars in 1463 bytes} [Thu Jan 27 16:36:37 2022] PUT /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63/groups/9119b3408d8849be8b2d15acf71e093c/roles/27ceba94bdd34cc790ee9e7b8fb06d57 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:36:37.221286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f533b7b-f6c6-4245-be8d-a334835a9a2f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.290965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9bf20-338e-42ae-a7d0-6cad9d504da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.292219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9bf20-338e-42ae-a7d0-6cad9d504da5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.292744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9bf20-338e-42ae-a7d0-6cad9d504da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.293459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9bf20-338e-42ae-a7d0-6cad9d504da5 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.295902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9bf20-338e-42ae-a7d0-6cad9d504da5 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.298176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9bf20-338e-42ae-a7d0-6cad9d504da5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.300581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 200/399] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:37.306203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98954acc-00ad-4962-ae29-73e7532d1bca admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.318146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1906f1-69a0-4496-8b11-6bac7ba83ff1 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.318433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1906f1-69a0-4496-8b11-6bac7ba83ff1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.318639 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1906f1-69a0-4496-8b11-6bac7ba83ff1 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.320564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 201/400] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:37.322083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98954acc-00ad-4962-ae29-73e7532d1bca admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.326234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87480f-a4d9-4248-9a5d-978fecfc7df7 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.326516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87480f-a4d9-4248-9a5d-978fecfc7df7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.326802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87480f-a4d9-4248-9a5d-978fecfc7df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.328858 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdff330-f3c1-4731-ad12-43424bb65caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.330228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdff330-f3c1-4731-ad12-43424bb65caf admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.330795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdff330-f3c1-4731-ad12-43424bb65caf admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.331620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdff330-f3c1-4731-ad12-43424bb65caf admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1/groups/9119b3408d8849be8b2d15acf71e093c/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.342089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdff330-f3c1-4731-ad12-43424bb65caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e316d140ed4e29a50b866b5c7569f1, group_id=9119b3408d8849be8b2d15acf71e093c, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.346256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdff330-f3c1-4731-ad12-43424bb65caf admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.359917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-5a87480f-a4d9-4248-9a5d-978fecfc7df7 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:37.361712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5a87480f-a4d9-4248-9a5d-978fecfc7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:37.370903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 200/401] 10.222.0.48 () {58 vars in 1463 bytes} [Thu Jan 27 16:36:37 2022] PUT /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1/groups/9119b3408d8849be8b2d15acf71e093c/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:37.445547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 202/402] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:37.483411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdff330-f3c1-4731-ad12-43424bb65caf admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.495435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdff330-f3c1-4731-ad12-43424bb65caf admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.501237 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4bdd9-caba-4880-82b5-135e0ab7d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.502356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4bdd9-caba-4880-82b5-135e0ab7d313 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.502828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4bdd9-caba-4880-82b5-135e0ab7d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.503315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4bdd9-caba-4880-82b5-135e0ab7d313 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.516914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4bdd9-caba-4880-82b5-135e0ab7d313 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:37.525080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-31f4bdd9-caba-4880-82b5-135e0ab7d313 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:37.526558 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 201/403] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:37.533275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87480f-a4d9-4248-9a5d-978fecfc7df7 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.545081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87480f-a4d9-4248-9a5d-978fecfc7df7 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.550840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a09c5-4ef2-4b9c-a06e-fe3173cc04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.551802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a09c5-4ef2-4b9c-a06e-fe3173cc04c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.552239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a09c5-4ef2-4b9c-a06e-fe3173cc04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.552720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a09c5-4ef2-4b9c-a06e-fe3173cc04c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.553714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a09c5-4ef2-4b9c-a06e-fe3173cc04c6 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:37.554172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a09c5-4ef2-4b9c-a06e-fe3173cc04c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.556186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a09c5-4ef2-4b9c-a06e-fe3173cc04c6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.567402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 203/404] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:37.573588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4bdd9-caba-4880-82b5-135e0ab7d313 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.586814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4bdd9-caba-4880-82b5-135e0ab7d313 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.593068 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab275b7-c858-4594-a126-f4d0c6dd5913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.594217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab275b7-c858-4594-a126-f4d0c6dd5913 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.594649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab275b7-c858-4594-a126-f4d0c6dd5913 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.595132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab275b7-c858-4594-a126-f4d0c6dd5913 admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.596702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab275b7-c858-4594-a126-f4d0c6dd5913 admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.598918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab275b7-c858-4594-a126-f4d0c6dd5913 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.601196 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 202/405] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:37.608021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a09c5-4ef2-4b9c-a06e-fe3173cc04c6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.621294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a09c5-4ef2-4b9c-a06e-fe3173cc04c6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.627638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7f8ae-29d0-4231-9c1a-5390e770cbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.628872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7f8ae-29d0-4231-9c1a-5390e770cbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.629304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7f8ae-29d0-4231-9c1a-5390e770cbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.629778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7f8ae-29d0-4231-9c1a-5390e770cbd7 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.631393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7f8ae-29d0-4231-9c1a-5390e770cbd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.633929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7f8ae-29d0-4231-9c1a-5390e770cbd7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.636317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 204/406] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:37 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:37.642995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab275b7-c858-4594-a126-f4d0c6dd5913 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:37.654695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab275b7-c858-4594-a126-f4d0c6dd5913 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:37.662151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70ba05-d71d-44d4-b5fd-7be502055e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:37.663265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ba05-d71d-44d4-b5fd-7be502055e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:37.663737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ba05-d71d-44d4-b5fd-7be502055e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:37.664187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70ba05-d71d-44d4-b5fd-7be502055e36 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1/groups/9119b3408d8849be8b2d15acf71e093c/roles/27ceba94bdd34cc790ee9e7b8fb06d57` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:37.666840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70ba05-d71d-44d4-b5fd-7be502055e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e316d140ed4e29a50b866b5c7569f1, group_id=9119b3408d8849be8b2d15acf71e093c, role_id=27ceba94bdd34cc790ee9e7b8fb06d57)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:37.670071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70ba05-d71d-44d4-b5fd-7be502055e36 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:37.685341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 203/407] 10.222.0.48 () {58 vars in 1463 bytes} [Thu Jan 27 16:36:37 2022] PUT /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1/groups/9119b3408d8849be8b2d15acf71e093c/roles/27ceba94bdd34cc790ee9e7b8fb06d57 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:38.112575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef813-ee5d-4cfb-b251-b97b8d52eb0f None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:38.113124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef813-ee5d-4cfb-b251-b97b8d52eb0f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:38.113549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eef813-ee5d-4cfb-b251-b97b8d52eb0f None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:38.115490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 205/408] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:38.120854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85522a5a-caea-474a-bce0-ca3ecfb0e2bb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:38.121977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85522a5a-caea-474a-bce0-ca3ecfb0e2bb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:38.122411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85522a5a-caea-474a-bce0-ca3ecfb0e2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:38.145326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-85522a5a-caea-474a-bce0-ca3ecfb0e2bb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:38.146853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-85522a5a-caea-474a-bce0-ca3ecfb0e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:38.214098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 204/409] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:38.253370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef813-ee5d-4cfb-b251-b97b8d52eb0f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:38.269646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eef813-ee5d-4cfb-b251-b97b8d52eb0f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:38.274518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef83e5-853f-4c68-9447-e69201316600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:38.275613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef83e5-853f-4c68-9447-e69201316600 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:38.276048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef83e5-853f-4c68-9447-e69201316600 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:38.276472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef83e5-853f-4c68-9447-e69201316600 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:38.289443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef83e5-853f-4c68-9447-e69201316600 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:38.297663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-f1ef83e5-853f-4c68-9447-e69201316600 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:38.299080 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 206/410] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:38.304964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85522a5a-caea-474a-bce0-ca3ecfb0e2bb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:38.314974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85522a5a-caea-474a-bce0-ca3ecfb0e2bb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:38.323918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcbb61-9d17-44ac-a7a7-74bb079140e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:38.325325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcbb61-9d17-44ac-a7a7-74bb079140e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:38.325605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcbb61-9d17-44ac-a7a7-74bb079140e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:38.325879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcbb61-9d17-44ac-a7a7-74bb079140e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:38.326656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcbb61-9d17-44ac-a7a7-74bb079140e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:38.326964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcbb61-9d17-44ac-a7a7-74bb079140e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:38.328657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcbb61-9d17-44ac-a7a7-74bb079140e7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:38.343652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 205/411] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:38.348682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef83e5-853f-4c68-9447-e69201316600 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:38.362171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef83e5-853f-4c68-9447-e69201316600 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:38.371704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624724d-65df-42f7-9419-91cb4a9d6633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:38.372941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624724d-65df-42f7-9419-91cb4a9d6633 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:38.373428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624724d-65df-42f7-9419-91cb4a9d6633 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:38.373904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624724d-65df-42f7-9419-91cb4a9d6633 admin admin] PATH_INFO: `/v3/groups/89b38cb2d8be42c0abbd5b50e9265923` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:38.376309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624724d-65df-42f7-9419-91cb4a9d6633 admin admin] RBAC: Authorizing `identity:get_group(group_id=89b38cb2d8be42c0abbd5b50e9265923)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:38.378436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c624724d-65df-42f7-9419-91cb4a9d6633 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:38.380307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 207/412] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:38 2022] GET /identity/v3/groups/89b38cb2d8be42c0abbd5b50e9265923 => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:38.385793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcbb61-9d17-44ac-a7a7-74bb079140e7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:38.400606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcbb61-9d17-44ac-a7a7-74bb079140e7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:38.411275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc99b-ef72-4b1d-88ef-f20ddfd2ce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:38.412174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc99b-ef72-4b1d-88ef-f20ddfd2ce7b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:38.412453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc99b-ef72-4b1d-88ef-f20ddfd2ce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:38.412726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc99b-ef72-4b1d-88ef-f20ddfd2ce7b admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:38.416337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc99b-ef72-4b1d-88ef-f20ddfd2ce7b admin admin] RBAC: Authorizing `identity:get_project(project_id=0e1134f718c7471d948ccfe1ca59674e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:38.418250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc99b-ef72-4b1d-88ef-f20ddfd2ce7b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:38.420657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 206/413] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:38 2022] GET /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e => generated 344 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:38.426176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624724d-65df-42f7-9419-91cb4a9d6633 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:38.440683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624724d-65df-42f7-9419-91cb4a9d6633 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:38.452509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23025745-4c1e-4bb3-a825-beacc567fe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:38.453771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23025745-4c1e-4bb3-a825-beacc567fe11 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:38.456283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23025745-4c1e-4bb3-a825-beacc567fe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:38.456809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23025745-4c1e-4bb3-a825-beacc567fe11 admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e/groups/89b38cb2d8be42c0abbd5b50e9265923/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:38.459128 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23025745-4c1e-4bb3-a825-beacc567fe11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1134f718c7471d948ccfe1ca59674e, group_id=89b38cb2d8be42c0abbd5b50e9265923, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:38.462047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23025745-4c1e-4bb3-a825-beacc567fe11 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:38.480705 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 208/414] 10.222.0.48 () {58 vars in 1463 bytes} [Thu Jan 27 16:36:38 2022] PUT /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e/groups/89b38cb2d8be42c0abbd5b50e9265923/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:40.000760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad31ba-acfc-42a6-8254-08cdab6b23d3 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.001758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad31ba-acfc-42a6-8254-08cdab6b23d3 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.002251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad31ba-acfc-42a6-8254-08cdab6b23d3 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.004563 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 207/415] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:40.009740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83621-e460-49ce-838b-c77975232bbe None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.010172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83621-e460-49ce-838b-c77975232bbe None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.010346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee83621-e460-49ce-838b-c77975232bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.024828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0fddb-d313-410f-8be4-1e87f3163340 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.025442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0fddb-d313-410f-8be4-1e87f3163340 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.025972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0fddb-d313-410f-8be4-1e87f3163340 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.028671 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 208/416] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:40.034601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-bee83621-e460-49ce-838b-c77975232bbe None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:40.035220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cc15-eac3-4817-b4a2-2f7f1a0fe799 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.035750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cc15-eac3-4817-b4a2-2f7f1a0fe799 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.035855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-bee83621-e460-49ce-838b-c77975232bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:40.036349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54cc15-eac3-4817-b4a2-2f7f1a0fe799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.066486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-4a54cc15-eac3-4817-b4a2-2f7f1a0fe799 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:40.067712 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4a54cc15-eac3-4817-b4a2-2f7f1a0fe799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:40.132818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 209/417] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:40.134249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7737e8-81ae-4bec-a6ba-c704371654d0 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.134544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7737e8-81ae-4bec-a6ba-c704371654d0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.134819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7737e8-81ae-4bec-a6ba-c704371654d0 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.137539 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 210/418] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:40.143150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a80148-e40d-4da0-b852-a465cb25ec1a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.143558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a80148-e40d-4da0-b852-a465cb25ec1a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.143780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a80148-e40d-4da0-b852-a465cb25ec1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.150085 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 209/419] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:40.167310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cc15-eac3-4817-b4a2-2f7f1a0fe799 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.177576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54cc15-eac3-4817-b4a2-2f7f1a0fe799 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.182512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1da07-779c-4b26-aee4-8f9c72555fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.183316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1da07-779c-4b26-aee4-8f9c72555fab admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.183637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1da07-779c-4b26-aee4-8f9c72555fab admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.184594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1da07-779c-4b26-aee4-8f9c72555fab admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.185532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-c2a80148-e40d-4da0-b852-a465cb25ec1a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:40.186749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c2a80148-e40d-4da0-b852-a465cb25ec1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:40.195973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 211/420] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:40.196702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1da07-779c-4b26-aee4-8f9c72555fab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:40.196810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a80148-e40d-4da0-b852-a465cb25ec1a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.205273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-40c1da07-779c-4b26-aee4-8f9c72555fab admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:40.206936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 210/421] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:40.212570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1da07-779c-4b26-aee4-8f9c72555fab admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.212811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a80148-e40d-4da0-b852-a465cb25ec1a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.223118 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1da07-779c-4b26-aee4-8f9c72555fab admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.227742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e7072-c258-4cd0-bc4b-48c6c7f785b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.228798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e7072-c258-4cd0-bc4b-48c6c7f785b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.229345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e7072-c258-4cd0-bc4b-48c6c7f785b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.229655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab0fd4-fbc0-4b5c-8bab-9a47a59c1ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.230012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e7072-c258-4cd0-bc4b-48c6c7f785b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.230470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0fd4-fbc0-4b5c-8bab-9a47a59c1ddf admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.230780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0fd4-fbc0-4b5c-8bab-9a47a59c1ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.231162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab0fd4-fbc0-4b5c-8bab-9a47a59c1ddf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.231643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e7072-c258-4cd0-bc4b-48c6c7f785b3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:40.232212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e7072-c258-4cd0-bc4b-48c6c7f785b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.234015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e7072-c258-4cd0-bc4b-48c6c7f785b3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.244767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 211/422] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:40.245844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e7072-c258-4cd0-bc4b-48c6c7f785b3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.250924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab0fd4-fbc0-4b5c-8bab-9a47a59c1ddf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:40.256248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-26ab0fd4-fbc0-4b5c-8bab-9a47a59c1ddf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:40.257228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 212/423] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:40.257868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab0fd4-fbc0-4b5c-8bab-9a47a59c1ddf admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.265850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e7072-c258-4cd0-bc4b-48c6c7f785b3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.271063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab0fd4-fbc0-4b5c-8bab-9a47a59c1ddf admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.272683 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cff6c6-3286-4ce4-ae17-0c52faa65b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.273544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cff6c6-3286-4ce4-ae17-0c52faa65b6a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.273918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cff6c6-3286-4ce4-ae17-0c52faa65b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.274289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cff6c6-3286-4ce4-ae17-0c52faa65b6a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.276945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d934-9dee-4307-91a1-cd23cabfe56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.278402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d934-9dee-4307-91a1-cd23cabfe56c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.278865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d934-9dee-4307-91a1-cd23cabfe56c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.279383 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4d934-9dee-4307-91a1-cd23cabfe56c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.287882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cff6c6-3286-4ce4-ae17-0c52faa65b6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:40.289949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4d934-9dee-4307-91a1-cd23cabfe56c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.291978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4d934-9dee-4307-91a1-cd23cabfe56c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.295914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-70cff6c6-3286-4ce4-ae17-0c52faa65b6a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jan 27 16:36:40.301942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 212/424] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:40.301942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cff6c6-3286-4ce4-ae17-0c52faa65b6a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.304655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 213/425] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:40.305467 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d934-9dee-4307-91a1-cd23cabfe56c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.315710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4d934-9dee-4307-91a1-cd23cabfe56c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.316880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cff6c6-3286-4ce4-ae17-0c52faa65b6a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.321432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbf551-6276-4320-909b-aa3434213118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.322146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbf551-6276-4320-909b-aa3434213118 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.322491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbf551-6276-4320-909b-aa3434213118 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.322797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbf551-6276-4320-909b-aa3434213118 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.323613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbf551-6276-4320-909b-aa3434213118 admin admin] RBAC: Adding query filter params (name=member) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:40.323905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbf551-6276-4320-909b-aa3434213118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.324595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3f8db-9300-49e9-8ab4-723e5bf9e590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.325488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3f8db-9300-49e9-8ab4-723e5bf9e590 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.325971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3f8db-9300-49e9-8ab4-723e5bf9e590 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.326093 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bbf551-6276-4320-909b-aa3434213118 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.326570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3f8db-9300-49e9-8ab4-723e5bf9e590 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.327532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3f8db-9300-49e9-8ab4-723e5bf9e590 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:40.328075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3f8db-9300-49e9-8ab4-723e5bf9e590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.329872 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3f8db-9300-49e9-8ab4-723e5bf9e590 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.336360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 214/426] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.337215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbf551-6276-4320-909b-aa3434213118 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.346171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 213/427] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.347446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3f8db-9300-49e9-8ab4-723e5bf9e590 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.350180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbf551-6276-4320-909b-aa3434213118 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.355344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516202b6-d7d3-40be-b8ab-1567cae17a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.356778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516202b6-d7d3-40be-b8ab-1567cae17a0e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.357129 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516202b6-d7d3-40be-b8ab-1567cae17a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.357470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516202b6-d7d3-40be-b8ab-1567cae17a0e admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.358920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516202b6-d7d3-40be-b8ab-1567cae17a0e admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.360186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3f8db-9300-49e9-8ab4-723e5bf9e590 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.361069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516202b6-d7d3-40be-b8ab-1567cae17a0e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.363145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 215/428] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.367663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516202b6-d7d3-40be-b8ab-1567cae17a0e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.373116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af192d9-5009-4a16-a828-0c7afef7f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.374132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af192d9-5009-4a16-a828-0c7afef7f3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.374632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af192d9-5009-4a16-a828-0c7afef7f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.375135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af192d9-5009-4a16-a828-0c7afef7f3b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.378523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516202b6-d7d3-40be-b8ab-1567cae17a0e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.383506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cd348-065c-45da-8498-d783f6b3a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.384214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd348-065c-45da-8498-d783f6b3a03a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.384497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd348-065c-45da-8498-d783f6b3a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.384829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd348-065c-45da-8498-d783f6b3a03a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.386074 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af192d9-5009-4a16-a828-0c7afef7f3b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.388230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af192d9-5009-4a16-a828-0c7afef7f3b2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.393877 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cd348-065c-45da-8498-d783f6b3a03a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.395730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cd348-065c-45da-8498-d783f6b3a03a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.398483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 214/429] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:40.399492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af192d9-5009-4a16-a828-0c7afef7f3b2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.410746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 216/430] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:40.410746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cd348-065c-45da-8498-d783f6b3a03a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.415168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af192d9-5009-4a16-a828-0c7afef7f3b2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.420066 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58b2b5-c14b-488b-95e8-e356e8a6abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.420578 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cd348-065c-45da-8498-d783f6b3a03a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.421467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58b2b5-c14b-488b-95e8-e356e8a6abbb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.422025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58b2b5-c14b-488b-95e8-e356e8a6abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.422538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58b2b5-c14b-488b-95e8-e356e8a6abbb admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.424131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58b2b5-c14b-488b-95e8-e356e8a6abbb admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.425677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52824b-467e-4444-b323-e11180a619d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.426730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58b2b5-c14b-488b-95e8-e356e8a6abbb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.426845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52824b-467e-4444-b323-e11180a619d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.427211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52824b-467e-4444-b323-e11180a619d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.427612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52824b-467e-4444-b323-e11180a619d9 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.428995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52824b-467e-4444-b323-e11180a619d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.429331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 215/431] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.430272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58b2b5-c14b-488b-95e8-e356e8a6abbb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.431260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52824b-467e-4444-b323-e11180a619d9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.436773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 217/432] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.440262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52824b-467e-4444-b323-e11180a619d9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.446334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58b2b5-c14b-488b-95e8-e356e8a6abbb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.455593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677a364-d72c-455f-b202-b1151db4aa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.455593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677a364-d72c-455f-b202-b1151db4aa00 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.455593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677a364-d72c-455f-b202-b1151db4aa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.455593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677a364-d72c-455f-b202-b1151db4aa00 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.455968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677a364-d72c-455f-b202-b1151db4aa00 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.456039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52824b-467e-4444-b323-e11180a619d9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.456657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677a364-d72c-455f-b202-b1151db4aa00 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.458779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 216/433] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.459217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89513d4-a41f-4a89-bf85-30c1296185ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.459677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677a364-d72c-455f-b202-b1151db4aa00 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.459951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89513d4-a41f-4a89-bf85-30c1296185ef admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.460278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89513d4-a41f-4a89-bf85-30c1296185ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.460601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89513d4-a41f-4a89-bf85-30c1296185ef admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.461498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89513d4-a41f-4a89-bf85-30c1296185ef admin admin] RBAC: Adding query filter params (group.id=9119b3408d8849be8b2d15acf71e093c, role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=9fb3d018836e4765a6346dd80809dc63) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:40.461806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89513d4-a41f-4a89-bf85-30c1296185ef admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.463820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89513d4-a41f-4a89-bf85-30c1296185ef admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.471914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 218/434] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/role_assignments?group.id=9119b3408d8849be8b2d15acf71e093c&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.472844 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89513d4-a41f-4a89-bf85-30c1296185ef admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.482238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677a364-d72c-455f-b202-b1151db4aa00 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.484030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89513d4-a41f-4a89-bf85-30c1296185ef admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.487149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c303dd-11ea-4b8a-9cc0-5e78a28df6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.488289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c303dd-11ea-4b8a-9cc0-5e78a28df6ed admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.488577 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c303dd-11ea-4b8a-9cc0-5e78a28df6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.488686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5969-2f04-40cf-8c69-fbbe4b99ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.488852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c303dd-11ea-4b8a-9cc0-5e78a28df6ed admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.489568 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5969-2f04-40cf-8c69-fbbe4b99ce94 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.489901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5969-2f04-40cf-8c69-fbbe4b99ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.490051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c303dd-11ea-4b8a-9cc0-5e78a28df6ed admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.490223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5969-2f04-40cf-8c69-fbbe4b99ce94 admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.493015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c303dd-11ea-4b8a-9cc0-5e78a28df6ed admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.494855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 217/435] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.498278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d5969-2f04-40cf-8c69-fbbe4b99ce94 admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.500384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d5969-2f04-40cf-8c69-fbbe4b99ce94 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.502515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c303dd-11ea-4b8a-9cc0-5e78a28df6ed admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.503792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 219/436] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.510731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5969-2f04-40cf-8c69-fbbe4b99ce94 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:40.523462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c303dd-11ea-4b8a-9cc0-5e78a28df6ed admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.528957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6da14-7339-42a5-b36d-f4dee61f12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.529630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6da14-7339-42a5-b36d-f4dee61f12fa admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.529964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6da14-7339-42a5-b36d-f4dee61f12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.530131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5969-2f04-40cf-8c69-fbbe4b99ce94 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:40.530293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6da14-7339-42a5-b36d-f4dee61f12fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.531135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6da14-7339-42a5-b36d-f4dee61f12fa admin admin] RBAC: Adding query filter params (group.id=9119b3408d8849be8b2d15acf71e093c, role.id=77071b28cf624ed1b3bd0dd30d0910b2, scope.project.id=63e316d140ed4e29a50b866b5c7569f1) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:40.531495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6da14-7339-42a5-b36d-f4dee61f12fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.536320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6da14-7339-42a5-b36d-f4dee61f12fa admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.544283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 218/437] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/role_assignments?group.id=9119b3408d8849be8b2d15acf71e093c&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=77071b28cf624ed1b3bd0dd30d0910b2 => generated 611 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:40.545179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014b71-0341-4f79-abdb-abfe264d092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:40.546294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014b71-0341-4f79-abdb-abfe264d092d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.546814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014b71-0341-4f79-abdb-abfe264d092d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.547317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014b71-0341-4f79-abdb-abfe264d092d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.548963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47014b71-0341-4f79-abdb-abfe264d092d admin admin] RBAC: Adding query filter params (group.id=9119b3408d8849be8b2d15acf71e093c, role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=9fb3d018836e4765a6346dd80809dc63) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:40.549540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47014b71-0341-4f79-abdb-abfe264d092d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:40.552123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47014b71-0341-4f79-abdb-abfe264d092d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:40.561907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 220/438] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:40 2022] GET /identity/v3/role_assignments?group.id=9119b3408d8849be8b2d15acf71e093c&scope.project.id=9fb3d018836e4765a6346dd80809dc63&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 611 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:40.983152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b463-f73d-4cdb-ab66-fa03510c5979 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.983522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b463-f73d-4cdb-ab66-fa03510c5979 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.983790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b463-f73d-4cdb-ab66-fa03510c5979 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:40.985497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 219/439] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:40.990904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aea03-df37-43a3-9bde-3110f6645c23 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:40.991194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aea03-df37-43a3-9bde-3110f6645c23 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:40.991471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aea03-df37-43a3-9bde-3110f6645c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.009731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-045aea03-df37-43a3-9bde-3110f6645c23 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:41.011258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-045aea03-df37-43a3-9bde-3110f6645c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:41.019811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 221/440] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:41.043534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b463-f73d-4cdb-ab66-fa03510c5979 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.056353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b463-f73d-4cdb-ab66-fa03510c5979 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.061301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b64c-6db9-4f49-938c-180be773a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.062109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b64c-6db9-4f49-938c-180be773a008 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.062390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b64c-6db9-4f49-938c-180be773a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.062666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26b64c-6db9-4f49-938c-180be773a008 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.074159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d26b64c-6db9-4f49-938c-180be773a008 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:41.081647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-3d26b64c-6db9-4f49-938c-180be773a008 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:41.082844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 220/441] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:41.088735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aea03-df37-43a3-9bde-3110f6645c23 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.098838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aea03-df37-43a3-9bde-3110f6645c23 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.103340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f134f8-83c9-40ff-a6f8-a9624a1bd292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.104102 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f134f8-83c9-40ff-a6f8-a9624a1bd292 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.104394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f134f8-83c9-40ff-a6f8-a9624a1bd292 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.104677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f134f8-83c9-40ff-a6f8-a9624a1bd292 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.105451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f134f8-83c9-40ff-a6f8-a9624a1bd292 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:41.106397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f134f8-83c9-40ff-a6f8-a9624a1bd292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.108617 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f134f8-83c9-40ff-a6f8-a9624a1bd292 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.117223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 222/442] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:41.122997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b64c-6db9-4f49-938c-180be773a008 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.133622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26b64c-6db9-4f49-938c-180be773a008 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.138298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d91939-7263-4f50-86c4-2f6a852f6b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.138946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d91939-7263-4f50-86c4-2f6a852f6b5a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.139238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d91939-7263-4f50-86c4-2f6a852f6b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.139516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d91939-7263-4f50-86c4-2f6a852f6b5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.149865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d91939-7263-4f50-86c4-2f6a852f6b5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.151543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d91939-7263-4f50-86c4-2f6a852f6b5a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.161770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 221/443] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:36:41.167268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f134f8-83c9-40ff-a6f8-a9624a1bd292 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.177737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f134f8-83c9-40ff-a6f8-a9624a1bd292 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.182480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e05898-d62b-45b1-8e81-8699fcbd1113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.183340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05898-d62b-45b1-8e81-8699fcbd1113 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.183684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05898-d62b-45b1-8e81-8699fcbd1113 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.184502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e05898-d62b-45b1-8e81-8699fcbd1113 admin admin] PATH_INFO: `/v3/projects/63e316d140ed4e29a50b866b5c7569f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.186094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e05898-d62b-45b1-8e81-8699fcbd1113 admin admin] RBAC: Authorizing `identity:get_project(project_id=63e316d140ed4e29a50b866b5c7569f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.188199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e05898-d62b-45b1-8e81-8699fcbd1113 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.190200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 223/444] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/projects/63e316d140ed4e29a50b866b5c7569f1 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:41.195458 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d91939-7263-4f50-86c4-2f6a852f6b5a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.206319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d91939-7263-4f50-86c4-2f6a852f6b5a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.210992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab390fc4-c970-43e4-8439-a1dacfcbbf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.211875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab390fc4-c970-43e4-8439-a1dacfcbbf40 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.212160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab390fc4-c970-43e4-8439-a1dacfcbbf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.212438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab390fc4-c970-43e4-8439-a1dacfcbbf40 admin admin] PATH_INFO: `/v3/groups/9119b3408d8849be8b2d15acf71e093c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.215874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab390fc4-c970-43e4-8439-a1dacfcbbf40 admin admin] RBAC: Authorizing `identity:get_group(group_id=9119b3408d8849be8b2d15acf71e093c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.217854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab390fc4-c970-43e4-8439-a1dacfcbbf40 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.219653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 222/445] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/groups/9119b3408d8849be8b2d15acf71e093c => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:41.225353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e05898-d62b-45b1-8e81-8699fcbd1113 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.235448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e05898-d62b-45b1-8e81-8699fcbd1113 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.239793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f4e1f-e55a-4068-ba39-304e262f404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.240439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f4e1f-e55a-4068-ba39-304e262f404f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.240734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f4e1f-e55a-4068-ba39-304e262f404f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.240997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f4e1f-e55a-4068-ba39-304e262f404f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.241843 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f4e1f-e55a-4068-ba39-304e262f404f admin admin] RBAC: Adding query filter params (group.id=9119b3408d8849be8b2d15acf71e093c, role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=63e316d140ed4e29a50b866b5c7569f1) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:41.242147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f4e1f-e55a-4068-ba39-304e262f404f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.244018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f4e1f-e55a-4068-ba39-304e262f404f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.250821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 224/446] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/role_assignments?group.id=9119b3408d8849be8b2d15acf71e093c&scope.project.id=63e316d140ed4e29a50b866b5c7569f1&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:41.641271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a9db3-1833-491d-9ad8-a7088be84a43 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.641553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a9db3-1833-491d-9ad8-a7088be84a43 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.641826 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a9db3-1833-491d-9ad8-a7088be84a43 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.643590 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 223/447] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:41.649025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a900857-6a2f-4fed-b53a-2b969a6a4ef7 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.649313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a900857-6a2f-4fed-b53a-2b969a6a4ef7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.649595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a900857-6a2f-4fed-b53a-2b969a6a4ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.668413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-0a900857-6a2f-4fed-b53a-2b969a6a4ef7 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:41.670419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0a900857-6a2f-4fed-b53a-2b969a6a4ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:41.679366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 225/448] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:41.707464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a9db3-1833-491d-9ad8-a7088be84a43 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.720515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a9db3-1833-491d-9ad8-a7088be84a43 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.724703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801412ba-c8a1-458d-b9eb-5074c9fa9fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.725477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801412ba-c8a1-458d-b9eb-5074c9fa9fad admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.725759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801412ba-c8a1-458d-b9eb-5074c9fa9fad admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.726034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801412ba-c8a1-458d-b9eb-5074c9fa9fad admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.736795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801412ba-c8a1-458d-b9eb-5074c9fa9fad admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:41.743600 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-801412ba-c8a1-458d-b9eb-5074c9fa9fad admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:41.744743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 224/449] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:41.750337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a900857-6a2f-4fed-b53a-2b969a6a4ef7 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.759037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a900857-6a2f-4fed-b53a-2b969a6a4ef7 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.763346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8682f06-b8b1-40b6-8e5a-82200585fc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.764016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8682f06-b8b1-40b6-8e5a-82200585fc30 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.764319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8682f06-b8b1-40b6-8e5a-82200585fc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.764576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8682f06-b8b1-40b6-8e5a-82200585fc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.765327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8682f06-b8b1-40b6-8e5a-82200585fc30 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:41.765630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8682f06-b8b1-40b6-8e5a-82200585fc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.767235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8682f06-b8b1-40b6-8e5a-82200585fc30 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.775103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 226/450] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:41.780867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801412ba-c8a1-458d-b9eb-5074c9fa9fad admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.790514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801412ba-c8a1-458d-b9eb-5074c9fa9fad admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.795390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbaa6e-4491-468b-b600-c0d6e244afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.796039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbaa6e-4491-468b-b600-c0d6e244afdc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.796320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbaa6e-4491-468b-b600-c0d6e244afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.796592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbaa6e-4491-468b-b600-c0d6e244afdc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.804653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbaa6e-4491-468b-b600-c0d6e244afdc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.806310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bbaa6e-4491-468b-b600-c0d6e244afdc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.815100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 225/451] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:41.820343 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8682f06-b8b1-40b6-8e5a-82200585fc30 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.829472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8682f06-b8b1-40b6-8e5a-82200585fc30 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.833625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696d4e3-1fd7-48dd-8383-c921a4804751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.834445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d4e3-1fd7-48dd-8383-c921a4804751 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.834752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d4e3-1fd7-48dd-8383-c921a4804751 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.835026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696d4e3-1fd7-48dd-8383-c921a4804751 admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.836214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696d4e3-1fd7-48dd-8383-c921a4804751 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e1134f718c7471d948ccfe1ca59674e)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.837956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696d4e3-1fd7-48dd-8383-c921a4804751 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.839536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 227/452] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:41.844850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbaa6e-4491-468b-b600-c0d6e244afdc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.853230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbaa6e-4491-468b-b600-c0d6e244afdc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.858414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f5471-ea9e-407f-9a76-984e0bc65dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.859225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f5471-ea9e-407f-9a76-984e0bc65dcb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.859507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f5471-ea9e-407f-9a76-984e0bc65dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.859813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f5471-ea9e-407f-9a76-984e0bc65dcb admin admin] PATH_INFO: `/v3/groups/89b38cb2d8be42c0abbd5b50e9265923` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.860968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f5471-ea9e-407f-9a76-984e0bc65dcb admin admin] RBAC: Authorizing `identity:get_group(group_id=89b38cb2d8be42c0abbd5b50e9265923)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.862809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f5471-ea9e-407f-9a76-984e0bc65dcb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.864352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 226/453] 10.222.0.48 () {56 vars in 1201 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/groups/89b38cb2d8be42c0abbd5b50e9265923 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:41.869392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696d4e3-1fd7-48dd-8383-c921a4804751 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:41.878563 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696d4e3-1fd7-48dd-8383-c921a4804751 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:41.882717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34080f-61ce-489e-8aeb-b60af47d0c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:41.883318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34080f-61ce-489e-8aeb-b60af47d0c41 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:41.883623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34080f-61ce-489e-8aeb-b60af47d0c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:41.883902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34080f-61ce-489e-8aeb-b60af47d0c41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:41.884715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34080f-61ce-489e-8aeb-b60af47d0c41 admin admin] RBAC: Adding query filter params (group.id=89b38cb2d8be42c0abbd5b50e9265923, role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=0e1134f718c7471d948ccfe1ca59674e) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:41.885023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34080f-61ce-489e-8aeb-b60af47d0c41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:41.886797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34080f-61ce-489e-8aeb-b60af47d0c41 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:41.892496 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 228/454] 10.222.0.48 () {56 vars in 1397 bytes} [Thu Jan 27 16:36:41 2022] GET /identity/v3/role_assignments?group.id=89b38cb2d8be42c0abbd5b50e9265923&scope.project.id=0e1134f718c7471d948ccfe1ca59674e&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:44.794902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59867854-419b-4502-8d37-b0cc554ebeeb None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:44.795448 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59867854-419b-4502-8d37-b0cc554ebeeb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:44.795448 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59867854-419b-4502-8d37-b0cc554ebeeb None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:44.797297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 227/455] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:44.802781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05672ce5-3323-4f4b-b69f-43f263a4eb27 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:44.803446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05672ce5-3323-4f4b-b69f-43f263a4eb27 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:44.803446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05672ce5-3323-4f4b-b69f-43f263a4eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:44.827619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-05672ce5-3323-4f4b-b69f-43f263a4eb27 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:44.828816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-05672ce5-3323-4f4b-b69f-43f263a4eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:44.836907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 229/456] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:44.874168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59867854-419b-4502-8d37-b0cc554ebeeb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:44.898895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59867854-419b-4502-8d37-b0cc554ebeeb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:44.906162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c91f0-5943-40c5-89fd-e5e582f45a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:44.907813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c91f0-5943-40c5-89fd-e5e582f45a6c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:44.908280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c91f0-5943-40c5-89fd-e5e582f45a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:44.908738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c91f0-5943-40c5-89fd-e5e582f45a6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:44.925638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c91f0-5943-40c5-89fd-e5e582f45a6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:44.927970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c91f0-5943-40c5-89fd-e5e582f45a6c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:44.940588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804a716-41e1-45ca-8d07-3a02196aab3b None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:44.940873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804a716-41e1-45ca-8d07-3a02196aab3b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:44.941158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0804a716-41e1-45ca-8d07-3a02196aab3b None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:44.943121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 230/457] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:44.948503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f995c-0da4-44b3-960f-d351e16b6217 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:44.948790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f995c-0da4-44b3-960f-d351e16b6217 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:44.949068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f995c-0da4-44b3-960f-d351e16b6217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:44.957498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-3f6c91f0-5943-40c5-89fd-e5e582f45a6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:44.959209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 228/458] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:44.964877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c91f0-5943-40c5-89fd-e5e582f45a6c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:44.976471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8e0f995c-0da4-44b3-960f-d351e16b6217 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:44.978154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8e0f995c-0da4-44b3-960f-d351e16b6217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:44.980915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c91f0-5943-40c5-89fd-e5e582f45a6c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:44.989702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:44.990596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:44.991592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:44.992996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 231/459] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:44.993470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:44.994395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:44.994903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:44.996158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:44.996158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:44.996158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:44.998031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.020832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f995c-0da4-44b3-960f-d351e16b6217 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.030849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 229/460] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:45.031147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f995c-0da4-44b3-960f-d351e16b6217 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.037146 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.046427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072637b-4214-4b9a-8a18-80f283b3c538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.047558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072637b-4214-4b9a-8a18-80f283b3c538 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.048062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072637b-4214-4b9a-8a18-80f283b3c538 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.048519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072637b-4214-4b9a-8a18-80f283b3c538 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.056321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51673-9318-4313-becb-44c4e4b9dd87 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.061057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb2c78-8fa0-41ad-b901-cb4f613dc06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.061726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb2c78-8fa0-41ad-b901-cb4f613dc06b admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.062012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb2c78-8fa0-41ad-b901-cb4f613dc06b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.062289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb2c78-8fa0-41ad-b901-cb4f613dc06b admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.063015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb2c78-8fa0-41ad-b901-cb4f613dc06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.063337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072637b-4214-4b9a-8a18-80f283b3c538 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.064996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb2c78-8fa0-41ad-b901-cb4f613dc06b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.065665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072637b-4214-4b9a-8a18-80f283b3c538 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.084769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-8072637b-4214-4b9a-8a18-80f283b3c538 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:45.086359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 232/461] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:45.087514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 230/462] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:45 2022] POST /identity/v3/users => generated 246 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:36:45.087775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77c1ef-07b2-4ebd-9657-93817f98f2c2 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.088049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77c1ef-07b2-4ebd-9657-93817f98f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.088325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77c1ef-07b2-4ebd-9657-93817f98f2c2 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.090134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 233/463] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:45.092946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb2c78-8fa0-41ad-b901-cb4f613dc06b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.096689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32071d6-2f09-4cbe-b05a-5258eb343dc2 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.097032 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32071d6-2f09-4cbe-b05a-5258eb343dc2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.097274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32071d6-2f09-4cbe-b05a-5258eb343dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.109045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb2c78-8fa0-41ad-b901-cb4f613dc06b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.115897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30dcc-1623-4c4d-8c77-9edc1cfb84ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.117201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30dcc-1623-4c4d-8c77-9edc1cfb84ef admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.117715 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30dcc-1623-4c4d-8c77-9edc1cfb84ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.117917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e32071d6-2f09-4cbe-b05a-5258eb343dc2 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:45.118401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b30dcc-1623-4c4d-8c77-9edc1cfb84ef admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.119113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e32071d6-2f09-4cbe-b05a-5258eb343dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:45.119745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30dcc-1623-4c4d-8c77-9edc1cfb84ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:45.120709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30dcc-1623-4c4d-8c77-9edc1cfb84ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.123742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b30dcc-1623-4c4d-8c77-9edc1cfb84ef admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.128211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 234/464] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:45.140194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 231/465] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:45.147726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32071d6-2f09-4cbe-b05a-5258eb343dc2 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.166328 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32071d6-2f09-4cbe-b05a-5258eb343dc2 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.177997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30dcc-1623-4c4d-8c77-9edc1cfb84ef admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.179351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476f9e5-4256-4a7a-8fe7-91fc5f34bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.180077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476f9e5-4256-4a7a-8fe7-91fc5f34bda0 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.180363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476f9e5-4256-4a7a-8fe7-91fc5f34bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.180637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476f9e5-4256-4a7a-8fe7-91fc5f34bda0 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.181368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476f9e5-4256-4a7a-8fe7-91fc5f34bda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.183291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476f9e5-4256-4a7a-8fe7-91fc5f34bda0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.202143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b30dcc-1623-4c4d-8c77-9edc1cfb84ef admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.213343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491b49f-6b8d-4b07-a781-95a5f19d3aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.214163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491b49f-6b8d-4b07-a781-95a5f19d3aba admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.214451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491b49f-6b8d-4b07-a781-95a5f19d3aba admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.214963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491b49f-6b8d-4b07-a781-95a5f19d3aba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.221283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 235/466] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:45 2022] POST /identity/v3/users => generated 248 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:45.240367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491b49f-6b8d-4b07-a781-95a5f19d3aba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.242315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491b49f-6b8d-4b07-a781-95a5f19d3aba admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.263549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-2491b49f-6b8d-4b07-a781-95a5f19d3aba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:45.265323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 232/467] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:45.271540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476f9e5-4256-4a7a-8fe7-91fc5f34bda0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.282192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476f9e5-4256-4a7a-8fe7-91fc5f34bda0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.287001 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11e12d-81d6-462c-8ff4-21ba1d9ed1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.287772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e12d-81d6-462c-8ff4-21ba1d9ed1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.288065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e12d-81d6-462c-8ff4-21ba1d9ed1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.288395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11e12d-81d6-462c-8ff4-21ba1d9ed1f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.289157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11e12d-81d6-462c-8ff4-21ba1d9ed1f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:45.289518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11e12d-81d6-462c-8ff4-21ba1d9ed1f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.291212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11e12d-81d6-462c-8ff4-21ba1d9ed1f9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.305699 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 236/468] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:45.311384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491b49f-6b8d-4b07-a781-95a5f19d3aba admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.328348 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491b49f-6b8d-4b07-a781-95a5f19d3aba admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.334771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fabe4f-e8ad-4dab-b525-6edb43724973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.335922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabe4f-e8ad-4dab-b525-6edb43724973 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.336432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabe4f-e8ad-4dab-b525-6edb43724973 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.336888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fabe4f-e8ad-4dab-b525-6edb43724973 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.337887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fabe4f-e8ad-4dab-b525-6edb43724973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.340055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fabe4f-e8ad-4dab-b525-6edb43724973 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.365771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 233/469] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:45 2022] POST /identity/v3/users => generated 248 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:45.425889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e0dfd-5c07-48e4-870b-4b93db3f00b1 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.426462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e0dfd-5c07-48e4-870b-4b93db3f00b1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.426943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e0dfd-5c07-48e4-870b-4b93db3f00b1 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.429549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 237/470] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:45.436878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda5b8b-98ae-44a9-a212-9ef2b5e70331 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.436878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda5b8b-98ae-44a9-a212-9ef2b5e70331 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.436878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda5b8b-98ae-44a9-a212-9ef2b5e70331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.460719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2cda5b8b-98ae-44a9-a212-9ef2b5e70331 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:45.461964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2cda5b8b-98ae-44a9-a212-9ef2b5e70331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:45.472695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 234/471] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:45.500576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e0dfd-5c07-48e4-870b-4b93db3f00b1 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.517645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e0dfd-5c07-48e4-870b-4b93db3f00b1 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.523135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a21b-fe1e-46d1-9044-88cfb2ad5014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.524360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a21b-fe1e-46d1-9044-88cfb2ad5014 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.524864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a21b-fe1e-46d1-9044-88cfb2ad5014 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.525340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3a21b-fe1e-46d1-9044-88cfb2ad5014 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.541598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3a21b-fe1e-46d1-9044-88cfb2ad5014 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.545181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3a21b-fe1e-46d1-9044-88cfb2ad5014 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.568567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-44e3a21b-fe1e-46d1-9044-88cfb2ad5014 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:45.569881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 238/472] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:45.576029 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda5b8b-98ae-44a9-a212-9ef2b5e70331 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.586005 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda5b8b-98ae-44a9-a212-9ef2b5e70331 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.592170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508dc8a-2c34-4f27-94f8-8cb32f9b8f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.593122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508dc8a-2c34-4f27-94f8-8cb32f9b8f1d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.593624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508dc8a-2c34-4f27-94f8-8cb32f9b8f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.594094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508dc8a-2c34-4f27-94f8-8cb32f9b8f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.595032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508dc8a-2c34-4f27-94f8-8cb32f9b8f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:45.595554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508dc8a-2c34-4f27-94f8-8cb32f9b8f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.597600 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508dc8a-2c34-4f27-94f8-8cb32f9b8f1d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.611928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 235/473] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:45.617125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a21b-fe1e-46d1-9044-88cfb2ad5014 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.636575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3a21b-fe1e-46d1-9044-88cfb2ad5014 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.645204 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13796063-c04a-4f02-b784-aa83ad8da2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.646185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796063-c04a-4f02-b784-aa83ad8da2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.646640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796063-c04a-4f02-b784-aa83ad8da2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.647085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13796063-c04a-4f02-b784-aa83ad8da2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.648035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13796063-c04a-4f02-b784-aa83ad8da2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.650303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13796063-c04a-4f02-b784-aa83ad8da2e1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.676670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 239/474] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:45 2022] POST /identity/v3/users => generated 249 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:45.785086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdbbae-7736-4e64-9f50-2b59ec5f9946 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.785721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdbbae-7736-4e64-9f50-2b59ec5f9946 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.786189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdbbae-7736-4e64-9f50-2b59ec5f9946 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.788225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 236/475] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:45.794828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbe91e-3377-4753-9be3-26543eb680bf None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.795231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbe91e-3377-4753-9be3-26543eb680bf None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.795598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbe91e-3377-4753-9be3-26543eb680bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.823868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-c4fbe91e-3377-4753-9be3-26543eb680bf None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:45.825740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c4fbe91e-3377-4753-9be3-26543eb680bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:45.837323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 240/476] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:45.863027 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdbbae-7736-4e64-9f50-2b59ec5f9946 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.879083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdbbae-7736-4e64-9f50-2b59ec5f9946 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.883462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.884158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.884446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.884717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.885492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.887099 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.894311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.sql.core [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jan 27 16:36:45.894311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jan 27 16:36:45.894311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [parameters: {'id': '85401de1e4f64097b690f26e0f6184f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jan 27 16:36:45.894311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90785) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 27 16:36:45.910941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jan 27 16:36:45.913054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 237/477] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:36:45 2022] POST /identity/v3/roles => generated 144 bytes in 50 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:45.919309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbe91e-3377-4753-9be3-26543eb680bf None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.929955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbe91e-3377-4753-9be3-26543eb680bf None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.934711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc22613-8459-4712-bca0-0e4924332457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.935513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22613-8459-4712-bca0-0e4924332457 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.935828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22613-8459-4712-bca0-0e4924332457 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.936110 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc22613-8459-4712-bca0-0e4924332457 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.946967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc22613-8459-4712-bca0-0e4924332457 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:45.954901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-8bc22613-8459-4712-bca0-0e4924332457 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jan 27 16:36:45.956396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 241/478] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:36:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:45.962028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:45.973425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1658c21e-b78e-4a70-9751-95f07e817139 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:45.977984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8200fb1-c3c9-4fbf-82b6-8a5575e8ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:45.978636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8200fb1-c3c9-4fbf-82b6-8a5575e8ead1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:45.978923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8200fb1-c3c9-4fbf-82b6-8a5575e8ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:45.979199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8200fb1-c3c9-4fbf-82b6-8a5575e8ead1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:45.979999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8200fb1-c3c9-4fbf-82b6-8a5575e8ead1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:45.980308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8200fb1-c3c9-4fbf-82b6-8a5575e8ead1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:45.982619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8200fb1-c3c9-4fbf-82b6-8a5575e8ead1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:45.991522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 238/479] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:47.998060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766adc26-6b5f-44a2-b5af-870f38edc6f6 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:47.998540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766adc26-6b5f-44a2-b5af-870f38edc6f6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:47.998540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766adc26-6b5f-44a2-b5af-870f38edc6f6 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.000629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 242/480] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:48.005635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9292b-1ee0-476b-bb5b-3afb9341984b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.006024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9292b-1ee0-476b-bb5b-3afb9341984b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.006186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9292b-1ee0-476b-bb5b-3afb9341984b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.031313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-dcb9292b-1ee0-476b-bb5b-3afb9341984b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:48.032601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-dcb9292b-1ee0-476b-bb5b-3afb9341984b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:48.045535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 239/481] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:48.069638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766adc26-6b5f-44a2-b5af-870f38edc6f6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.085130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766adc26-6b5f-44a2-b5af-870f38edc6f6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.089682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d30621-ce2d-4712-9580-cacfec1e842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.090995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d30621-ce2d-4712-9580-cacfec1e842c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.091388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d30621-ce2d-4712-9580-cacfec1e842c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.091693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d30621-ce2d-4712-9580-cacfec1e842c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.112982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d30621-ce2d-4712-9580-cacfec1e842c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:48.126474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-17d30621-ce2d-4712-9580-cacfec1e842c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:48.128085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 243/482] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.133406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9292b-1ee0-476b-bb5b-3afb9341984b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.142769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9292b-1ee0-476b-bb5b-3afb9341984b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.146454 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96f871-10c2-4fbc-9ba9-32226cea99c6 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.146764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96f871-10c2-4fbc-9ba9-32226cea99c6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.147053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96f871-10c2-4fbc-9ba9-32226cea99c6 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.149098 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 244/483] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:48.155546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b1ab3-c006-4ad8-83b5-0c7a312e478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.156242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b1ab3-c006-4ad8-83b5-0c7a312e478e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.156527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b1ab3-c006-4ad8-83b5-0c7a312e478e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.156805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b1ab3-c006-4ad8-83b5-0c7a312e478e admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.157576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b1ab3-c006-4ad8-83b5-0c7a312e478e admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.158144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b1ab3-c006-4ad8-83b5-0c7a312e478e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.159812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b1ab3-c006-4ad8-83b5-0c7a312e478e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.169579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 240/484] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.174730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96f871-10c2-4fbc-9ba9-32226cea99c6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.175177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b063c-b12d-4da5-9e96-b3b5bb9739b4 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.175476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b063c-b12d-4da5-9e96-b3b5bb9739b4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.175788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b063c-b12d-4da5-9e96-b3b5bb9739b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.195613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96f871-10c2-4fbc-9ba9-32226cea99c6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.204926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-825b063c-b12d-4da5-9e96-b3b5bb9739b4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:48.206109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-825b063c-b12d-4da5-9e96-b3b5bb9739b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:48.207518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2abfd-4430-44e7-9537-753a9022e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.208337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2abfd-4430-44e7-9537-753a9022e7fd admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.208613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2abfd-4430-44e7-9537-753a9022e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.208881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2abfd-4430-44e7-9537-753a9022e7fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.224087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 241/485] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:48.233061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2abfd-4430-44e7-9537-753a9022e7fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.234933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2abfd-4430-44e7-9537-753a9022e7fd admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.249279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b063c-b12d-4da5-9e96-b3b5bb9739b4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.258801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b063c-b12d-4da5-9e96-b3b5bb9739b4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.270157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-71b2abfd-4430-44e7-9537-753a9022e7fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:48.271534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 245/486] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.277255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9a5c4-fda8-44c7-9d45-e0437fd2ba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.278626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a5c4-fda8-44c7-9d45-e0437fd2ba9a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.278996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a5c4-fda8-44c7-9d45-e0437fd2ba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.279481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a5c4-fda8-44c7-9d45-e0437fd2ba9a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.281852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2abfd-4430-44e7-9537-753a9022e7fd admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.293293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2abfd-4430-44e7-9537-753a9022e7fd admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.294693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb9a5c4-fda8-44c7-9d45-e0437fd2ba9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:48.298653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ea312b-9590-4c20-8313-76e58b160fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.299312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea312b-9590-4c20-8313-76e58b160fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.299616 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea312b-9590-4c20-8313-76e58b160fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.299881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ea312b-9590-4c20-8313-76e58b160fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.300620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea312b-9590-4c20-8313-76e58b160fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.300925 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea312b-9590-4c20-8313-76e58b160fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.302498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ea312b-9590-4c20-8313-76e58b160fe9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.303614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-acb9a5c4-fda8-44c7-9d45-e0437fd2ba9a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:48.306084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 242/487] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.307667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b655eca-0cbe-4e63-abf1-755535f17c7d None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.308155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b655eca-0cbe-4e63-abf1-755535f17c7d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.308719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b655eca-0cbe-4e63-abf1-755535f17c7d None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.312383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 243/488] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:48.317201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b655eca-0cbe-4e63-abf1-755535f17c7d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.320078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 246/489] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.321640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077f61e-1a05-4643-9a69-7b60e73f2ea2 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.322120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077f61e-1a05-4643-9a69-7b60e73f2ea2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.322609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077f61e-1a05-4643-9a69-7b60e73f2ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.330096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b655eca-0cbe-4e63-abf1-755535f17c7d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.334686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513cb75-3a05-4613-ae99-b191a966b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.335339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513cb75-3a05-4613-ae99-b191a966b071 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.335702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513cb75-3a05-4613-ae99-b191a966b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.335979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513cb75-3a05-4613-ae99-b191a966b071 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.336786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513cb75-3a05-4613-ae99-b191a966b071 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.337090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513cb75-3a05-4613-ae99-b191a966b071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.338755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513cb75-3a05-4613-ae99-b191a966b071 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.344880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3077f61e-1a05-4643-9a69-7b60e73f2ea2 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:48.347014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3077f61e-1a05-4643-9a69-7b60e73f2ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:48.348585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 244/490] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.349290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513cb75-3a05-4613-ae99-b191a966b071 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.356827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 247/491] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:48.363725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077f61e-1a05-4643-9a69-7b60e73f2ea2 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.366091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513cb75-3a05-4613-ae99-b191a966b071 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.373887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc93ee8-adf9-4792-b8ab-d3c9d04dbe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.375062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc93ee8-adf9-4792-b8ab-d3c9d04dbe77 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.375349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc93ee8-adf9-4792-b8ab-d3c9d04dbe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.375651 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc93ee8-adf9-4792-b8ab-d3c9d04dbe77 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.379963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077f61e-1a05-4643-9a69-7b60e73f2ea2 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.388197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc93ee8-adf9-4792-b8ab-d3c9d04dbe77 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.390350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b0d96-b11c-48cc-b77a-1b4005045aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.390745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc93ee8-adf9-4792-b8ab-d3c9d04dbe77 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.391739 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b0d96-b11c-48cc-b77a-1b4005045aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.392234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b0d96-b11c-48cc-b77a-1b4005045aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.392915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b0d96-b11c-48cc-b77a-1b4005045aa4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.404758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-2dc93ee8-adf9-4792-b8ab-d3c9d04dbe77 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 27 16:36:48.405524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b0d96-b11c-48cc-b77a-1b4005045aa4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.406281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 245/492] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.407117 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc93ee8-adf9-4792-b8ab-d3c9d04dbe77 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.408455 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b0d96-b11c-48cc-b77a-1b4005045aa4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.417150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc93ee8-adf9-4792-b8ab-d3c9d04dbe77 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.422460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb3b44-d50f-467e-baf6-f5d26f61937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.423298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb3b44-d50f-467e-baf6-f5d26f61937d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.423596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb3b44-d50f-467e-baf6-f5d26f61937d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.423984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb3b44-d50f-467e-baf6-f5d26f61937d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.429494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-773b0d96-b11c-48cc-b77a-1b4005045aa4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:48.430931 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 248/493] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.432134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b0d96-b11c-48cc-b77a-1b4005045aa4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.439113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb3b44-d50f-467e-baf6-f5d26f61937d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:48.443304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b0d96-b11c-48cc-b77a-1b4005045aa4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.446653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-ceeb3b44-d50f-467e-baf6-f5d26f61937d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:48.448219 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 246/494] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.448748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.449159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb3b44-d50f-467e-baf6-f5d26f61937d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.449857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.450857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.451604 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.452697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.453195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.454420 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:48.454420 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:36:48.454420 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:36:48.456847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.461168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb3b44-d50f-467e-baf6-f5d26f61937d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.466309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104565d8-f1b5-4176-abbc-3b7d71917e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.467178 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104565d8-f1b5-4176-abbc-3b7d71917e5e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.467464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104565d8-f1b5-4176-abbc-3b7d71917e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.467769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104565d8-f1b5-4176-abbc-3b7d71917e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.468638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104565d8-f1b5-4176-abbc-3b7d71917e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.469000 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104565d8-f1b5-4176-abbc-3b7d71917e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.470719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104565d8-f1b5-4176-abbc-3b7d71917e5e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.485104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 247/495] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.486111 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104565d8-f1b5-4176-abbc-3b7d71917e5e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.498226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104565d8-f1b5-4176-abbc-3b7d71917e5e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.502915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603397-00f0-4a83-ad63-24199e5f9603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.503592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603397-00f0-4a83-ad63-24199e5f9603 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.503877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603397-00f0-4a83-ad63-24199e5f9603 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.504154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603397-00f0-4a83-ad63-24199e5f9603 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.505048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603397-00f0-4a83-ad63-24199e5f9603 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.505355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603397-00f0-4a83-ad63-24199e5f9603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.507004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603397-00f0-4a83-ad63-24199e5f9603 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.510775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 249/496] 10.222.0.48 () {56 vars in 1154 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.511848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.516970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 248/497] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.517860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603397-00f0-4a83-ad63-24199e5f9603 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.524787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a6409-6899-4eef-8219-7a65d8f1e50a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.528707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603397-00f0-4a83-ad63-24199e5f9603 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.530680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7191fb-e160-4036-8fb3-6130d5d2ea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.531751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7191fb-e160-4036-8fb3-6130d5d2ea8c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.532228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7191fb-e160-4036-8fb3-6130d5d2ea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.532711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7191fb-e160-4036-8fb3-6130d5d2ea8c admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.534132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c282e3-4b9b-41da-9598-d228527ec7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.534847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c282e3-4b9b-41da-9598-d228527ec7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.535135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c282e3-4b9b-41da-9598-d228527ec7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.535413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c282e3-4b9b-41da-9598-d228527ec7d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.545530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7191fb-e160-4036-8fb3-6130d5d2ea8c admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.547137 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7191fb-e160-4036-8fb3-6130d5d2ea8c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.548589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c282e3-4b9b-41da-9598-d228527ec7d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.550319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c282e3-4b9b-41da-9598-d228527ec7d3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.561778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 249/498] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:48.562686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c282e3-4b9b-41da-9598-d228527ec7d3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.570360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-7e7191fb-e160-4036-8fb3-6130d5d2ea8c admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 27 16:36:48.571754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c282e3-4b9b-41da-9598-d228527ec7d3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.572131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 250/499] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.573073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7191fb-e160-4036-8fb3-6130d5d2ea8c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.577456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66d46-3783-4083-848f-1e51a72d81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.578699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66d46-3783-4083-848f-1e51a72d81a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.579167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66d46-3783-4083-848f-1e51a72d81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.579653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc66d46-3783-4083-848f-1e51a72d81a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.585913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7191fb-e160-4036-8fb3-6130d5d2ea8c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.592511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06a63d-0f46-4bdc-9335-38b0c3573bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.593117 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66d46-3783-4083-848f-1e51a72d81a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.593780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06a63d-0f46-4bdc-9335-38b0c3573bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.594253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06a63d-0f46-4bdc-9335-38b0c3573bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.594715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06a63d-0f46-4bdc-9335-38b0c3573bf6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.595177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc66d46-3783-4083-848f-1e51a72d81a4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.607868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06a63d-0f46-4bdc-9335-38b0c3573bf6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.609946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06a63d-0f46-4bdc-9335-38b0c3573bf6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.612982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-efc66d46-3783-4083-848f-1e51a72d81a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:48.614517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 250/500] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.615395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66d46-3783-4083-848f-1e51a72d81a4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.626534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc66d46-3783-4083-848f-1e51a72d81a4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.629997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-cf06a63d-0f46-4bdc-9335-38b0c3573bf6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:48.631382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.632017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 251/501] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.632185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.632438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.632829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.633552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06a63d-0f46-4bdc-9335-38b0c3573bf6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.633719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.634041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.635062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:48.635062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:48.635062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:48.636429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.644479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06a63d-0f46-4bdc-9335-38b0c3573bf6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.650502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe40cd0-b82c-42ba-a45e-1e482dbe0bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.651483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe40cd0-b82c-42ba-a45e-1e482dbe0bbb admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.652000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe40cd0-b82c-42ba-a45e-1e482dbe0bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.652515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe40cd0-b82c-42ba-a45e-1e482dbe0bbb admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.653730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe40cd0-b82c-42ba-a45e-1e482dbe0bbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.654498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe40cd0-b82c-42ba-a45e-1e482dbe0bbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.656642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe40cd0-b82c-42ba-a45e-1e482dbe0bbb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.674595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 252/502] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.676630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe40cd0-b82c-42ba-a45e-1e482dbe0bbb admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.679672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 251/503] 10.222.0.48 () {56 vars in 1158 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.680607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.689356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe40cd0-b82c-42ba-a45e-1e482dbe0bbb admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.690913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e25aa4-f3de-42db-b8ea-393df8f84067 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.695123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0f15-0c6b-4ce0-ab8e-cee479fb0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.695412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3681e-d598-4ae1-b67b-4767ce1c499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.696253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3681e-d598-4ae1-b67b-4767ce1c499f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.696534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3681e-d598-4ae1-b67b-4767ce1c499f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.696807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3681e-d598-4ae1-b67b-4767ce1c499f admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.696915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0f15-0c6b-4ce0-ab8e-cee479fb0b7a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.697577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0f15-0c6b-4ce0-ab8e-cee479fb0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.698047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0f15-0c6b-4ce0-ab8e-cee479fb0b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.699271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0f15-0c6b-4ce0-ab8e-cee479fb0b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.700971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0f15-0c6b-4ce0-ab8e-cee479fb0b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.702810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca0f15-0c6b-4ce0-ab8e-cee479fb0b7a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.706076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3681e-d598-4ae1-b67b-4767ce1c499f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.707945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3681e-d598-4ae1-b67b-4767ce1c499f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.717801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 253/504] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.718880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0f15-0c6b-4ce0-ab8e-cee479fb0b7a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.722805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-13c3681e-d598-4ae1-b67b-4767ce1c499f admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 27 16:36:48.724282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 252/505] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.725087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3681e-d598-4ae1-b67b-4767ce1c499f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.729394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0f15-0c6b-4ce0-ab8e-cee479fb0b7a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.735771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f713c-154d-4bb8-a6bb-0d8f16095ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.736495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3681e-d598-4ae1-b67b-4767ce1c499f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.736867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f713c-154d-4bb8-a6bb-0d8f16095ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.737337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f713c-154d-4bb8-a6bb-0d8f16095ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.737826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f713c-154d-4bb8-a6bb-0d8f16095ca6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.741167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb1a6d-6988-4922-b991-53c2ef7e73c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.741980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1a6d-6988-4922-b991-53c2ef7e73c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.742258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1a6d-6988-4922-b991-53c2ef7e73c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.742581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb1a6d-6988-4922-b991-53c2ef7e73c8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.748839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f713c-154d-4bb8-a6bb-0d8f16095ca6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.750954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb1a6d-6988-4922-b991-53c2ef7e73c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.751335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f713c-154d-4bb8-a6bb-0d8f16095ca6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.752976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb1a6d-6988-4922-b991-53c2ef7e73c8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.761692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 254/506] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:48.763246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f713c-154d-4bb8-a6bb-0d8f16095ca6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.766903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c1cb1a6d-6988-4922-b991-53c2ef7e73c8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:48.768464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 253/507] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.769344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb1a6d-6988-4922-b991-53c2ef7e73c8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.773438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f713c-154d-4bb8-a6bb-0d8f16095ca6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.780272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0190e4-77c4-4945-970f-3a581b7225ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.780937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb1a6d-6988-4922-b991-53c2ef7e73c8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.781043 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0190e4-77c4-4945-970f-3a581b7225ad admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.781214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0190e4-77c4-4945-970f-3a581b7225ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.781517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0190e4-77c4-4945-970f-3a581b7225ad admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.782366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0190e4-77c4-4945-970f-3a581b7225ad admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.782678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0190e4-77c4-4945-970f-3a581b7225ad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.784889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0190e4-77c4-4945-970f-3a581b7225ad admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.785758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad974b-72ce-4ba1-87e6-4c965affb6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.786629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad974b-72ce-4ba1-87e6-4c965affb6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.786805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad974b-72ce-4ba1-87e6-4c965affb6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.787063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad974b-72ce-4ba1-87e6-4c965affb6e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.798063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad974b-72ce-4ba1-87e6-4c965affb6e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.799941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad974b-72ce-4ba1-87e6-4c965affb6e0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.802395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 255/508] 10.222.0.48 () {56 vars in 1158 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.803051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0190e4-77c4-4945-970f-3a581b7225ad admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.812786 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0190e4-77c4-4945-970f-3a581b7225ad admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.817108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.817740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.818020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.818293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.819079 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.819384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.820421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:48.820421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:36:48.820421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:36:48.821530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-1cad974b-72ce-4ba1-87e6-4c965affb6e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:48.821627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.823765 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 254/509] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.824249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf0833-a6b1-42bc-821e-44a3d9946bc1 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.824588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf0833-a6b1-42bc-821e-44a3d9946bc1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.824872 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf0833-a6b1-42bc-821e-44a3d9946bc1 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.827787 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 255/510] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:48.828469 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf0833-a6b1-42bc-821e-44a3d9946bc1 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.842481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 256/511] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.843517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.849362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf0833-a6b1-42bc-821e-44a3d9946bc1 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.853383 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3d7eb-aff7-40b6-a13c-238c9d608d5b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.856895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dea5e-d850-4222-a5b0-ed2145b788a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.857994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dea5e-d850-4222-a5b0-ed2145b788a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.858306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa38a8-b741-4f5b-b3a9-36991e7eb07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.858511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dea5e-d850-4222-a5b0-ed2145b788a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.858942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa38a8-b741-4f5b-b3a9-36991e7eb07b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.859096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dea5e-d850-4222-a5b0-ed2145b788a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.859333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa38a8-b741-4f5b-b3a9-36991e7eb07b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.859634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa38a8-b741-4f5b-b3a9-36991e7eb07b admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.860346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa38a8-b741-4f5b-b3a9-36991e7eb07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.860658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa38a8-b741-4f5b-b3a9-36991e7eb07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.862257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa38a8-b741-4f5b-b3a9-36991e7eb07b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.870168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dea5e-d850-4222-a5b0-ed2145b788a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.872608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dea5e-d850-4222-a5b0-ed2145b788a6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.878688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 257/512] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.878688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d537e5-fb84-49ec-b21d-b330597d797e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.878688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d537e5-fb84-49ec-b21d-b330597d797e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.878688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d537e5-fb84-49ec-b21d-b330597d797e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.890208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 256/513] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:48.890208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dea5e-d850-4222-a5b0-ed2145b788a6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.895025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-51d537e5-fb84-49ec-b21d-b330597d797e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:48.896420 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-51d537e5-fb84-49ec-b21d-b330597d797e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:48.899901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dea5e-d850-4222-a5b0-ed2145b788a6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.904532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 258/514] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:48.904675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d369c-32a8-468c-b627-fcf44387a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.905351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d369c-32a8-468c-b627-fcf44387a2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.905736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d369c-32a8-468c-b627-fcf44387a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.906066 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d369c-32a8-468c-b627-fcf44387a2e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.906954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d369c-32a8-468c-b627-fcf44387a2e7 admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=8500a8d242bf43a9b2fd538c3b1bb037) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:48.907313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d369c-32a8-468c-b627-fcf44387a2e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.909753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d369c-32a8-468c-b627-fcf44387a2e7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.915673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 257/515] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/role_assignments?user.id=8500a8d242bf43a9b2fd538c3b1bb037&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:48.923594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d369c-32a8-468c-b627-fcf44387a2e7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.923791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d537e5-fb84-49ec-b21d-b330597d797e None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.933107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d537e5-fb84-49ec-b21d-b330597d797e None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.936856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d369c-32a8-468c-b627-fcf44387a2e7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.938598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa362bf-1fad-4f8b-84a3-0b3888750479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.939615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa362bf-1fad-4f8b-84a3-0b3888750479 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.939910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa362bf-1fad-4f8b-84a3-0b3888750479 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.940193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa362bf-1fad-4f8b-84a3-0b3888750479 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.941804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f070f1-84c5-4090-abfe-a796803cf98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.942615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f070f1-84c5-4090-abfe-a796803cf98e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.942892 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f070f1-84c5-4090-abfe-a796803cf98e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.943178 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f070f1-84c5-4090-abfe-a796803cf98e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.947981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa362bf-1fad-4f8b-84a3-0b3888750479 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.950614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa362bf-1fad-4f8b-84a3-0b3888750479 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.955230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f070f1-84c5-4090-abfe-a796803cf98e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:48.957142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f070f1-84c5-4090-abfe-a796803cf98e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:48.964717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-dfa362bf-1fad-4f8b-84a3-0b3888750479 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:48.966114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 259/516] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.967401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6aba-ac1f-4b10-a780-55a4e089641b None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.967715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6aba-ac1f-4b10-a780-55a4e089641b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.967999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6aba-ac1f-4b10-a780-55a4e089641b None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.973029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 260/517] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:48.973989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6aba-ac1f-4b10-a780-55a4e089641b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.982034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-27f070f1-84c5-4090-abfe-a796803cf98e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:48.983546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 258/518] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:48.987277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6aba-ac1f-4b10-a780-55a4e089641b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:48.988707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f070f1-84c5-4090-abfe-a796803cf98e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:48.991718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b68c7-d996-453c-8556-e2634514246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:48.992522 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b68c7-d996-453c-8556-e2634514246f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:48.992804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b68c7-d996-453c-8556-e2634514246f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:48.993071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b68c7-d996-453c-8556-e2634514246f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:48.999429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f070f1-84c5-4090-abfe-a796803cf98e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.004265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.004962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.005324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.005672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.006239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b68c7-d996-453c-8556-e2634514246f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:49.006632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.007061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.008228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:49.008228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:49.008228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:49.009600 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.014373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-cd7b68c7-d996-453c-8556-e2634514246f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:49.020731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 261/519] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:49.020731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2ffc-7319-45b8-8660-ae384c52c5f5 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.020731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2ffc-7319-45b8-8660-ae384c52c5f5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.020731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb2ffc-7319-45b8-8660-ae384c52c5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.035521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 259/520] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.035521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.038498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-9adb2ffc-7319-45b8-8660-ae384c52c5f5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:49.039819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9adb2ffc-7319-45b8-8660-ae384c52c5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:49.045751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e36f7-b7f3-492a-b83d-1aece43a88ff admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.048165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 262/521] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:49.049109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2ffc-7319-45b8-8660-ae384c52c5f5 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.058497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4e81d-b6cd-4973-b2dc-d1211a190d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.058691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb2ffc-7319-45b8-8660-ae384c52c5f5 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.060581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4e81d-b6cd-4973-b2dc-d1211a190d8f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.061060 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4e81d-b6cd-4973-b2dc-d1211a190d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.061530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4e81d-b6cd-4973-b2dc-d1211a190d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.062469 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4e81d-b6cd-4973-b2dc-d1211a190d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.062984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4e81d-b6cd-4973-b2dc-d1211a190d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.064247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9782b-db0d-409b-9b24-c5764d93010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.065033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9782b-db0d-409b-9b24-c5764d93010b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.065149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4e81d-b6cd-4973-b2dc-d1211a190d8f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.065488 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9782b-db0d-409b-9b24-c5764d93010b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.065862 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9782b-db0d-409b-9b24-c5764d93010b admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.066741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9782b-db0d-409b-9b24-c5764d93010b admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.067151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9782b-db0d-409b-9b24-c5764d93010b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.068913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9782b-db0d-409b-9b24-c5764d93010b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.079659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 263/522] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.080141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9782b-db0d-409b-9b24-c5764d93010b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.083663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 260/523] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.083663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4e81d-b6cd-4973-b2dc-d1211a190d8f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.094304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4e81d-b6cd-4973-b2dc-d1211a190d8f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.095072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9782b-db0d-409b-9b24-c5764d93010b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.099560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8d04-df0d-41be-bf77-e13a0d3d58eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.100347 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8d04-df0d-41be-bf77-e13a0d3d58eb admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.100446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b3a23-2a2f-486c-9562-eaa0da8c56c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.100626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8d04-df0d-41be-bf77-e13a0d3d58eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.100903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8d04-df0d-41be-bf77-e13a0d3d58eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.101222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b3a23-2a2f-486c-9562-eaa0da8c56c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.101504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b3a23-2a2f-486c-9562-eaa0da8c56c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.101837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8d04-df0d-41be-bf77-e13a0d3d58eb admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=a62aede1113047fc80983b85ae0cbfe2) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.101931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b3a23-2a2f-486c-9562-eaa0da8c56c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.102153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8d04-df0d-41be-bf77-e13a0d3d58eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.104244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8d04-df0d-41be-bf77-e13a0d3d58eb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.110489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 264/524] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/role_assignments?user.id=a62aede1113047fc80983b85ae0cbfe2&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.112732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8d04-df0d-41be-bf77-e13a0d3d58eb admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.113336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b3a23-2a2f-486c-9562-eaa0da8c56c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.115243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b3a23-2a2f-486c-9562-eaa0da8c56c6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.128927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8d04-df0d-41be-bf77-e13a0d3d58eb admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.135903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d4017-ae65-49b8-ae4b-39b2134b529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.137104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d4017-ae65-49b8-ae4b-39b2134b529d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.138160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d4017-ae65-49b8-ae4b-39b2134b529d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.138880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d4017-ae65-49b8-ae4b-39b2134b529d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.139434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-dc4b3a23-2a2f-486c-9562-eaa0da8c56c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:49.140852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 261/525] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:49.141669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b3a23-2a2f-486c-9562-eaa0da8c56c6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.152047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b3a23-2a2f-486c-9562-eaa0da8c56c6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.154774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d4017-ae65-49b8-ae4b-39b2134b529d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.157186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5d4017-ae65-49b8-ae4b-39b2134b529d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.157311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acc730-c0d5-4954-b5b0-03611e0d030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.158324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acc730-c0d5-4954-b5b0-03611e0d030b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.158696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acc730-c0d5-4954-b5b0-03611e0d030b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.158976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85acc730-c0d5-4954-b5b0-03611e0d030b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.166866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acc730-c0d5-4954-b5b0-03611e0d030b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.169523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85acc730-c0d5-4954-b5b0-03611e0d030b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.179120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-fc5d4017-ae65-49b8-ae4b-39b2134b529d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:49.181148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 265/526] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:49.182282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d4017-ae65-49b8-ae4b-39b2134b529d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.186036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-85acc730-c0d5-4954-b5b0-03611e0d030b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:49.192108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 262/527] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:49.193037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acc730-c0d5-4954-b5b0-03611e0d030b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.195125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d4017-ae65-49b8-ae4b-39b2134b529d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.201205 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041deca5-b011-43da-bf1b-0e94fc4403e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.202542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041deca5-b011-43da-bf1b-0e94fc4403e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.203036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041deca5-b011-43da-bf1b-0e94fc4403e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.203506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041deca5-b011-43da-bf1b-0e94fc4403e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.204159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85acc730-c0d5-4954-b5b0-03611e0d030b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.204693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041deca5-b011-43da-bf1b-0e94fc4403e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.205298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041deca5-b011-43da-bf1b-0e94fc4403e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.207255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041deca5-b011-43da-bf1b-0e94fc4403e5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.209344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d472e-78b9-4c84-8be2-8528aafbcf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.209990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d472e-78b9-4c84-8be2-8528aafbcf8a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.210276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d472e-78b9-4c84-8be2-8528aafbcf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.210611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d472e-78b9-4c84-8be2-8528aafbcf8a admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.211605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d472e-78b9-4c84-8be2-8528aafbcf8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.211797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d472e-78b9-4c84-8be2-8528aafbcf8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.213577 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d472e-78b9-4c84-8be2-8528aafbcf8a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.225101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 266/528] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.226381 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041deca5-b011-43da-bf1b-0e94fc4403e5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.226716 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 263/529] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.233132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d472e-78b9-4c84-8be2-8528aafbcf8a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.242889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041deca5-b011-43da-bf1b-0e94fc4403e5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.244979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d472e-78b9-4c84-8be2-8528aafbcf8a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.249180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db0be-6fd1-4a4f-9ab0-34892a07f1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.250231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db0be-6fd1-4a4f-9ab0-34892a07f1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.250653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db0be-6fd1-4a4f-9ab0-34892a07f1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.251009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09e7a9-68dd-473b-beab-8523ae0f511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.251240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4db0be-6fd1-4a4f-9ab0-34892a07f1e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.251906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e7a9-68dd-473b-beab-8523ae0f511c admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.252321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e7a9-68dd-473b-beab-8523ae0f511c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.252560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4db0be-6fd1-4a4f-9ab0-34892a07f1e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.252737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09e7a9-68dd-473b-beab-8523ae0f511c admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.253149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4db0be-6fd1-4a4f-9ab0-34892a07f1e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.253708 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09e7a9-68dd-473b-beab-8523ae0f511c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.255443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4db0be-6fd1-4a4f-9ab0-34892a07f1e4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.255989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09e7a9-68dd-473b-beab-8523ae0f511c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.272358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 267/530] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.273918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db0be-6fd1-4a4f-9ab0-34892a07f1e4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.281761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 264/531] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:36:49 2022] POST /identity/v3/users => generated 247 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:36:49.283488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09e7a9-68dd-473b-beab-8523ae0f511c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.287257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4db0be-6fd1-4a4f-9ab0-34892a07f1e4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.293401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9655b4e-0566-460f-ae82-077d0d187ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.294462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09e7a9-68dd-473b-beab-8523ae0f511c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.294955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655b4e-0566-460f-ae82-077d0d187ffb admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.295465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655b4e-0566-460f-ae82-077d0d187ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.295915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9655b4e-0566-460f-ae82-077d0d187ffb admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.300032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c126e5-ae37-404e-ae4f-b317b15a505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.300881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c126e5-ae37-404e-ae4f-b317b15a505e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.301311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c126e5-ae37-404e-ae4f-b317b15a505e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.301686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c126e5-ae37-404e-ae4f-b317b15a505e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.302761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c126e5-ae37-404e-ae4f-b317b15a505e admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=295fe8f61f87423bb49471e2f0085690) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.303198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c126e5-ae37-404e-ae4f-b317b15a505e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.305425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c126e5-ae37-404e-ae4f-b317b15a505e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.306276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9655b4e-0566-460f-ae82-077d0d187ffb admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.309766 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9655b4e-0566-460f-ae82-077d0d187ffb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.313544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 265/532] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/role_assignments?user.id=295fe8f61f87423bb49471e2f0085690&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.328688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-b9655b4e-0566-460f-ae82-077d0d187ffb admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 27 16:36:49.330659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 268/533] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:49.336655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c126e5-ae37-404e-ae4f-b317b15a505e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.350025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c126e5-ae37-404e-ae4f-b317b15a505e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.355277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318e8bd-0832-48f3-ab80-3f9cb16ffbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.356713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e8bd-0832-48f3-ab80-3f9cb16ffbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.357240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e8bd-0832-48f3-ab80-3f9cb16ffbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.357630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e8bd-0832-48f3-ab80-3f9cb16ffbc8 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.358682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318e8bd-0832-48f3-ab80-3f9cb16ffbc8 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.359154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318e8bd-0832-48f3-ab80-3f9cb16ffbc8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.361251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318e8bd-0832-48f3-ab80-3f9cb16ffbc8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.384347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 266/534] 10.222.0.48 () {56 vars in 1160 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.391973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9655b4e-0566-460f-ae82-077d0d187ffb admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.404776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9655b4e-0566-460f-ae82-077d0d187ffb admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.417155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46a8aa-fb1e-4ce9-a534-6f11b89a6f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.418085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46a8aa-fb1e-4ce9-a534-6f11b89a6f91 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.418533 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46a8aa-fb1e-4ce9-a534-6f11b89a6f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.419718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46a8aa-fb1e-4ce9-a534-6f11b89a6f91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.434023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46a8aa-fb1e-4ce9-a534-6f11b89a6f91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.437503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46a8aa-fb1e-4ce9-a534-6f11b89a6f91 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.457970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 269/535] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:49.459272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318e8bd-0832-48f3-ab80-3f9cb16ffbc8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.476602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318e8bd-0832-48f3-ab80-3f9cb16ffbc8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.488165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75bb9c-e080-4f23-a003-909a5ba88aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.489044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75bb9c-e080-4f23-a003-909a5ba88aed admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.489335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75bb9c-e080-4f23-a003-909a5ba88aed admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.489620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75bb9c-e080-4f23-a003-909a5ba88aed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.508063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75bb9c-e080-4f23-a003-909a5ba88aed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.509964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75bb9c-e080-4f23-a003-909a5ba88aed admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.531551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-fa75bb9c-e080-4f23-a003-909a5ba88aed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:49.531831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 267/536] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:49.537553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46a8aa-fb1e-4ce9-a534-6f11b89a6f91 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.551915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46a8aa-fb1e-4ce9-a534-6f11b89a6f91 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.556438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9fd50-5d57-4609-a1dc-f0d3da705e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.557104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9fd50-5d57-4609-a1dc-f0d3da705e1c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.557390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9fd50-5d57-4609-a1dc-f0d3da705e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.557722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9fd50-5d57-4609-a1dc-f0d3da705e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.558517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9fd50-5d57-4609-a1dc-f0d3da705e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.558851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9fd50-5d57-4609-a1dc-f0d3da705e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.561513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9fd50-5d57-4609-a1dc-f0d3da705e1c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.574227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 270/537] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.579923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75bb9c-e080-4f23-a003-909a5ba88aed admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.589943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75bb9c-e080-4f23-a003-909a5ba88aed admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.595788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de18f-0eb0-4c43-b3a4-b16a86992de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.596764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de18f-0eb0-4c43-b3a4-b16a86992de7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.597118 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de18f-0eb0-4c43-b3a4-b16a86992de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.597470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4de18f-0eb0-4c43-b3a4-b16a86992de7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.605159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de18f-0eb0-4c43-b3a4-b16a86992de7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.608217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4de18f-0eb0-4c43-b3a4-b16a86992de7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.622854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-bb4de18f-0eb0-4c43-b3a4-b16a86992de7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:49.624190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 268/538] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:49.630036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9fd50-5d57-4609-a1dc-f0d3da705e1c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.641189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9fd50-5d57-4609-a1dc-f0d3da705e1c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.646366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80dc070-f53c-4513-ab3d-4e76501d712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.647103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dc070-f53c-4513-ab3d-4e76501d712c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.647477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dc070-f53c-4513-ab3d-4e76501d712c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.647860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80dc070-f53c-4513-ab3d-4e76501d712c admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.648787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dc070-f53c-4513-ab3d-4e76501d712c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.649164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dc070-f53c-4513-ab3d-4e76501d712c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.651159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80dc070-f53c-4513-ab3d-4e76501d712c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.664368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 271/539] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:49.670334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de18f-0eb0-4c43-b3a4-b16a86992de7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:49.681215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4de18f-0eb0-4c43-b3a4-b16a86992de7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:49.686764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb3a0e-5e8e-41ba-b59a-6d5b528ea56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:49.687538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb3a0e-5e8e-41ba-b59a-6d5b528ea56c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:49.687929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb3a0e-5e8e-41ba-b59a-6d5b528ea56c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:49.688370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb3a0e-5e8e-41ba-b59a-6d5b528ea56c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:49.689306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb3a0e-5e8e-41ba-b59a-6d5b528ea56c admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=15ae418635734639a4d10676978e82cf) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:49.689620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb3a0e-5e8e-41ba-b59a-6d5b528ea56c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:49.691580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeb3a0e-5e8e-41ba-b59a-6d5b528ea56c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:49.697909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 269/540] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:49 2022] GET /identity/v3/role_assignments?user.id=15ae418635734639a4d10676978e82cf&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:51.273304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b37f2c-dd99-4ceb-a1b5-faafd41b8df0 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.274038 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b37f2c-dd99-4ceb-a1b5-faafd41b8df0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.274038 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b37f2c-dd99-4ceb-a1b5-faafd41b8df0 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.275886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 272/541] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:51.281933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c84f-4083-4dac-a666-1d01db13b96b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.282417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c84f-4083-4dac-a666-1d01db13b96b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.282565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c84f-4083-4dac-a666-1d01db13b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.301177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ad13c84f-4083-4dac-a666-1d01db13b96b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:51.302372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ad13c84f-4083-4dac-a666-1d01db13b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:51.310505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 270/542] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:51.333238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b37f2c-dd99-4ceb-a1b5-faafd41b8df0 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.346050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b37f2c-dd99-4ceb-a1b5-faafd41b8df0 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.350383 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d21e12-5020-4b3e-a010-0acc8214f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.351157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d21e12-5020-4b3e-a010-0acc8214f09d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.351440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d21e12-5020-4b3e-a010-0acc8214f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.351762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d21e12-5020-4b3e-a010-0acc8214f09d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.363559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d21e12-5020-4b3e-a010-0acc8214f09d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:51.370539 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-08d21e12-5020-4b3e-a010-0acc8214f09d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:51.372538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 273/543] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:51.378279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13c84f-4083-4dac-a666-1d01db13b96b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.389912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13c84f-4083-4dac-a666-1d01db13b96b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.394476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ec415-c349-43fe-b893-ebc7ddc5c667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.395147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ec415-c349-43fe-b893-ebc7ddc5c667 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.395428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ec415-c349-43fe-b893-ebc7ddc5c667 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.395736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ec415-c349-43fe-b893-ebc7ddc5c667 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.396493 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ec415-c349-43fe-b893-ebc7ddc5c667 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:51.396799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ec415-c349-43fe-b893-ebc7ddc5c667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.398396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ec415-c349-43fe-b893-ebc7ddc5c667 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.411495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 271/544] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:51.416882 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d21e12-5020-4b3e-a010-0acc8214f09d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.433609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d21e12-5020-4b3e-a010-0acc8214f09d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.444165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506ffdf-a10a-47f3-93da-c7c7bf86df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.444955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506ffdf-a10a-47f3-93da-c7c7bf86df88 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.445272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506ffdf-a10a-47f3-93da-c7c7bf86df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.445550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506ffdf-a10a-47f3-93da-c7c7bf86df88 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.456502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506ffdf-a10a-47f3-93da-c7c7bf86df88 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.458344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506ffdf-a10a-47f3-93da-c7c7bf86df88 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.475800 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-d506ffdf-a10a-47f3-93da-c7c7bf86df88 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:51.477257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 274/545] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:51.482943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ec415-c349-43fe-b893-ebc7ddc5c667 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.492528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ec415-c349-43fe-b893-ebc7ddc5c667 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.504807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10f5b5-379e-45a1-8017-63aaa4293b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.505482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10f5b5-379e-45a1-8017-63aaa4293b6a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.505766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10f5b5-379e-45a1-8017-63aaa4293b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.506044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10f5b5-379e-45a1-8017-63aaa4293b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.506783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10f5b5-379e-45a1-8017-63aaa4293b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:51.507088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10f5b5-379e-45a1-8017-63aaa4293b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.508740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10f5b5-379e-45a1-8017-63aaa4293b6a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.531712 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 272/546] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:51.537054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506ffdf-a10a-47f3-93da-c7c7bf86df88 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.552719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506ffdf-a10a-47f3-93da-c7c7bf86df88 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.563355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e103-7e35-4b79-adee-6cba6712c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.564175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e103-7e35-4b79-adee-6cba6712c089 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.564459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e103-7e35-4b79-adee-6cba6712c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.564737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e103-7e35-4b79-adee-6cba6712c089 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.576211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e103-7e35-4b79-adee-6cba6712c089 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.578286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e103-7e35-4b79-adee-6cba6712c089 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.594211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-18e1e103-7e35-4b79-adee-6cba6712c089 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 27 16:36:51.595815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 275/547] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:51.601440 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10f5b5-379e-45a1-8017-63aaa4293b6a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.612198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10f5b5-379e-45a1-8017-63aaa4293b6a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.620690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e971c9-e644-4d13-953a-9463f512e586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.621361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e971c9-e644-4d13-953a-9463f512e586 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.621641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e971c9-e644-4d13-953a-9463f512e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.621942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e971c9-e644-4d13-953a-9463f512e586 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.623533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e971c9-e644-4d13-953a-9463f512e586 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:51.623878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e971c9-e644-4d13-953a-9463f512e586 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.625719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e971c9-e644-4d13-953a-9463f512e586 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.653752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 273/548] 10.222.0.48 () {56 vars in 1154 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:51.659147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e103-7e35-4b79-adee-6cba6712c089 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.669347 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e103-7e35-4b79-adee-6cba6712c089 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.673829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59853308-3373-49a8-8638-bf57f705f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.674612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59853308-3373-49a8-8638-bf57f705f69c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.674888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59853308-3373-49a8-8638-bf57f705f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.675153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59853308-3373-49a8-8638-bf57f705f69c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.689670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59853308-3373-49a8-8638-bf57f705f69c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.691510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59853308-3373-49a8-8638-bf57f705f69c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.713272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-59853308-3373-49a8-8638-bf57f705f69c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:51.714755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 276/549] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:51.720817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e971c9-e644-4d13-953a-9463f512e586 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.730473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e971c9-e644-4d13-953a-9463f512e586 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.734994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4606d-1d12-4038-bf46-cea7bddbb769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.735670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4606d-1d12-4038-bf46-cea7bddbb769 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.735956 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4606d-1d12-4038-bf46-cea7bddbb769 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.736235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4606d-1d12-4038-bf46-cea7bddbb769 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.736970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4606d-1d12-4038-bf46-cea7bddbb769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:51.737276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4606d-1d12-4038-bf46-cea7bddbb769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.738863 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4606d-1d12-4038-bf46-cea7bddbb769 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.754587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 274/550] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:51.760013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59853308-3373-49a8-8638-bf57f705f69c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.775850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59853308-3373-49a8-8638-bf57f705f69c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.784282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf99470-c1ec-46d2-bded-4dfdb063f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.785014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf99470-c1ec-46d2-bded-4dfdb063f561 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.785289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf99470-c1ec-46d2-bded-4dfdb063f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.785566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf99470-c1ec-46d2-bded-4dfdb063f561 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.796745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf99470-c1ec-46d2-bded-4dfdb063f561 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.798721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf99470-c1ec-46d2-bded-4dfdb063f561 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.815985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-acf99470-c1ec-46d2-bded-4dfdb063f561 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:51.817484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 277/551] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:51.822930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4606d-1d12-4038-bf46-cea7bddbb769 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.834062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4606d-1d12-4038-bf46-cea7bddbb769 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.839660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0523a9f-dc94-4905-8b80-f1bb9170bee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.840216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961354e-8f72-418a-99df-1429c723504b None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.840327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0523a9f-dc94-4905-8b80-f1bb9170bee9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.840507 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961354e-8f72-418a-99df-1429c723504b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.840709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0523a9f-dc94-4905-8b80-f1bb9170bee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.840865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961354e-8f72-418a-99df-1429c723504b None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.841006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0523a9f-dc94-4905-8b80-f1bb9170bee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.842194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0523a9f-dc94-4905-8b80-f1bb9170bee9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:51.842510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0523a9f-dc94-4905-8b80-f1bb9170bee9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.842976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 278/552] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:51.844492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0523a9f-dc94-4905-8b80-f1bb9170bee9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.848034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b3b74-69a3-4f63-ae55-1c2c40c001ae None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.848322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b3b74-69a3-4f63-ae55-1c2c40c001ae None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.848602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b3b74-69a3-4f63-ae55-1c2c40c001ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.857440 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 275/553] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:51.862954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0523a9f-dc94-4905-8b80-f1bb9170bee9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.872800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0523a9f-dc94-4905-8b80-f1bb9170bee9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:51.877486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d37a-88d7-4390-b292-0922c14798d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:51.878382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d37a-88d7-4390-b292-0922c14798d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:51.878668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d37a-88d7-4390-b292-0922c14798d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:51.878971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67d37a-88d7-4390-b292-0922c14798d9 admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/8500a8d242bf43a9b2fd538c3b1bb037/roles/a22d2094a5364a8ba169d8e80f4402c5` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:51.883561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b38b3b74-69a3-4f63-ae55-1c2c40c001ae None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:51.884793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b38b3b74-69a3-4f63-ae55-1c2c40c001ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:51.896276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d37a-88d7-4390-b292-0922c14798d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=8500a8d242bf43a9b2fd538c3b1bb037, role_id=a22d2094a5364a8ba169d8e80f4402c5)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:51.899171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b67d37a-88d7-4390-b292-0922c14798d9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:51.910635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 279/554] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:51.915797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 276/555] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:51 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/8500a8d242bf43a9b2fd538c3b1bb037/roles/a22d2094a5364a8ba169d8e80f4402c5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:36:51.946599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b3b74-69a3-4f63-ae55-1c2c40c001ae None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:51.961278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b3b74-69a3-4f63-ae55-1c2c40c001ae None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.051050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf004a8-6112-437d-a7ae-55f558de867f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.051803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf004a8-6112-437d-a7ae-55f558de867f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.052091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf004a8-6112-437d-a7ae-55f558de867f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.052369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf004a8-6112-437d-a7ae-55f558de867f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.065398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf004a8-6112-437d-a7ae-55f558de867f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:52.072839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-adf004a8-6112-437d-a7ae-55f558de867f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:52.074438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 280/556] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:52.080957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d37a-88d7-4390-b292-0922c14798d9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.095877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b67d37a-88d7-4390-b292-0922c14798d9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.100678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969124f8-958c-4d65-a9de-d72d5d075dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.101575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969124f8-958c-4d65-a9de-d72d5d075dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.102186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969124f8-958c-4d65-a9de-d72d5d075dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.102663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969124f8-958c-4d65-a9de-d72d5d075dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.103720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969124f8-958c-4d65-a9de-d72d5d075dc4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.104225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969124f8-958c-4d65-a9de-d72d5d075dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.106024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969124f8-958c-4d65-a9de-d72d5d075dc4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.116407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 277/557] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.121924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf004a8-6112-437d-a7ae-55f558de867f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.133084 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf004a8-6112-437d-a7ae-55f558de867f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.138806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e233f-140a-46af-a249-b7ac3b0ad908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.140009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e233f-140a-46af-a249-b7ac3b0ad908 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.140560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e233f-140a-46af-a249-b7ac3b0ad908 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.141051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e233f-140a-46af-a249-b7ac3b0ad908 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.153164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e233f-140a-46af-a249-b7ac3b0ad908 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.155401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e233f-140a-46af-a249-b7ac3b0ad908 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.174848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-739e233f-140a-46af-a249-b7ac3b0ad908 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:52.176845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 281/558] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:52.182234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969124f8-958c-4d65-a9de-d72d5d075dc4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.194349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969124f8-958c-4d65-a9de-d72d5d075dc4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.199450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5047c5-b312-4f27-94ae-3cda75e44a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.201391 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5047c5-b312-4f27-94ae-3cda75e44a2d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.201909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5047c5-b312-4f27-94ae-3cda75e44a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.202417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5047c5-b312-4f27-94ae-3cda75e44a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.203386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5047c5-b312-4f27-94ae-3cda75e44a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.203927 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5047c5-b312-4f27-94ae-3cda75e44a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.205802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5047c5-b312-4f27-94ae-3cda75e44a2d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.219906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 278/559] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.226088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e233f-140a-46af-a249-b7ac3b0ad908 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.245203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e233f-140a-46af-a249-b7ac3b0ad908 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.251477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb611d-9914-4bca-845a-116ec8fc7711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.257111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb611d-9914-4bca-845a-116ec8fc7711 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.257642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb611d-9914-4bca-845a-116ec8fc7711 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.258137 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb611d-9914-4bca-845a-116ec8fc7711 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.270929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb611d-9914-4bca-845a-116ec8fc7711 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.273555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb611d-9914-4bca-845a-116ec8fc7711 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.293008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-e0fb611d-9914-4bca-845a-116ec8fc7711 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 27 16:36:52.295183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 282/560] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:52.300846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5047c5-b312-4f27-94ae-3cda75e44a2d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.312383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5047c5-b312-4f27-94ae-3cda75e44a2d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.323144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37f2ce-d8bd-40b3-b5eb-460cf363475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.324129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37f2ce-d8bd-40b3-b5eb-460cf363475e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.324686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37f2ce-d8bd-40b3-b5eb-460cf363475e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.325378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37f2ce-d8bd-40b3-b5eb-460cf363475e admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.326492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37f2ce-d8bd-40b3-b5eb-460cf363475e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.327001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37f2ce-d8bd-40b3-b5eb-460cf363475e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.329137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37f2ce-d8bd-40b3-b5eb-460cf363475e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.351679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 279/561] 10.222.0.48 () {56 vars in 1158 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.357215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb611d-9914-4bca-845a-116ec8fc7711 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.368560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb611d-9914-4bca-845a-116ec8fc7711 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.375900 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0179b9-533a-47af-b507-3c7654d78aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.377041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0179b9-533a-47af-b507-3c7654d78aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.377557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0179b9-533a-47af-b507-3c7654d78aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.378081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0179b9-533a-47af-b507-3c7654d78aa8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.393894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0179b9-533a-47af-b507-3c7654d78aa8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.396130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0179b9-533a-47af-b507-3c7654d78aa8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.417053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-ce0179b9-533a-47af-b507-3c7654d78aa8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:52.418794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 283/562] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:52.425448 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37f2ce-d8bd-40b3-b5eb-460cf363475e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.438830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37f2ce-d8bd-40b3-b5eb-460cf363475e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.444478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070c7b-e585-4798-8246-4b90791eec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.445419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070c7b-e585-4798-8246-4b90791eec03 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.446016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070c7b-e585-4798-8246-4b90791eec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.446490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070c7b-e585-4798-8246-4b90791eec03 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.447501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070c7b-e585-4798-8246-4b90791eec03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.448053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070c7b-e585-4798-8246-4b90791eec03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.449940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070c7b-e585-4798-8246-4b90791eec03 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.452786 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f529c44-d224-4e06-a371-293d69337c93 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.453384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f529c44-d224-4e06-a371-293d69337c93 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.453854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f529c44-d224-4e06-a371-293d69337c93 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.455897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 284/563] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:52.461046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1107-37a5-4737-ae4a-1d592974cb69 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.461316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1107-37a5-4737-ae4a-1d592974cb69 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.461602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e1107-37a5-4737-ae4a-1d592974cb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.476521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 280/564] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.482582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070c7b-e585-4798-8246-4b90791eec03 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.485257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-842e1107-37a5-4737-ae4a-1d592974cb69 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:52.486687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-842e1107-37a5-4737-ae4a-1d592974cb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:52.496743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070c7b-e585-4798-8246-4b90791eec03 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.501193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 285/565] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:52.504492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02384e8-afb8-4ab6-a67f-5e80e2525b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.505507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02384e8-afb8-4ab6-a67f-5e80e2525b53 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.506011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02384e8-afb8-4ab6-a67f-5e80e2525b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.506485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02384e8-afb8-4ab6-a67f-5e80e2525b53 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.523978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02384e8-afb8-4ab6-a67f-5e80e2525b53 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.526562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37491-c602-4e91-97b5-a69e5bf36988 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.527060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37491-c602-4e91-97b5-a69e5bf36988 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.527562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e37491-c602-4e91-97b5-a69e5bf36988 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.531196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 286/566] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:52.532884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02384e8-afb8-4ab6-a67f-5e80e2525b53 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.536484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094189de-d4b3-4bf0-b93b-5f8747ac7760 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.536968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094189de-d4b3-4bf0-b93b-5f8747ac7760 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.537474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094189de-d4b3-4bf0-b93b-5f8747ac7760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.552504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-e02384e8-afb8-4ab6-a67f-5e80e2525b53 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:52.554236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 281/567] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:52.555252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02384e8-afb8-4ab6-a67f-5e80e2525b53 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.556536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-094189de-d4b3-4bf0-b93b-5f8747ac7760 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:52.557793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-094189de-d4b3-4bf0-b93b-5f8747ac7760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:52.571658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 287/568] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:52.571658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094189de-d4b3-4bf0-b93b-5f8747ac7760 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.573501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02384e8-afb8-4ab6-a67f-5e80e2525b53 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.583917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514e45f-4f9d-4e66-aef7-166e0da38fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.584769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e45f-4f9d-4e66-aef7-166e0da38fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.585055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e45f-4f9d-4e66-aef7-166e0da38fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.585383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e45f-4f9d-4e66-aef7-166e0da38fd7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.592573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094189de-d4b3-4bf0-b93b-5f8747ac7760 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.598572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ce887-1ffc-454f-ac7e-5b9fa918c3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.599499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ce887-1ffc-454f-ac7e-5b9fa918c3aa admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.600009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ce887-1ffc-454f-ac7e-5b9fa918c3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.600481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ce887-1ffc-454f-ac7e-5b9fa918c3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.601501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ce887-1ffc-454f-ac7e-5b9fa918c3aa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.601997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514e45f-4f9d-4e66-aef7-166e0da38fd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:52.602234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ce887-1ffc-454f-ac7e-5b9fa918c3aa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.604337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ce887-1ffc-454f-ac7e-5b9fa918c3aa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.609455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c514e45f-4f9d-4e66-aef7-166e0da38fd7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:52.615476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 282/569] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:52.615476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514e45f-4f9d-4e66-aef7-166e0da38fd7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.621737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514e45f-4f9d-4e66-aef7-166e0da38fd7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.625970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 288/570] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.626797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ce887-1ffc-454f-ac7e-5b9fa918c3aa admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.637252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6271d-36dd-4607-8be2-c949ae24d194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.638816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6271d-36dd-4607-8be2-c949ae24d194 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.639102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6271d-36dd-4607-8be2-c949ae24d194 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.639379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6271d-36dd-4607-8be2-c949ae24d194 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.642023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ce887-1ffc-454f-ac7e-5b9fa918c3aa admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.646668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b45ea4-ab49-4ad4-a906-77a80bfdf451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.647399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b45ea4-ab49-4ad4-a906-77a80bfdf451 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.647703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b45ea4-ab49-4ad4-a906-77a80bfdf451 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.647978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b45ea4-ab49-4ad4-a906-77a80bfdf451 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.648731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b45ea4-ab49-4ad4-a906-77a80bfdf451 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.649032 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b45ea4-ab49-4ad4-a906-77a80bfdf451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.650608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b45ea4-ab49-4ad4-a906-77a80bfdf451 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.651396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6271d-36dd-4607-8be2-c949ae24d194 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:52.659668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 289/571] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.660570 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b45ea4-ab49-4ad4-a906-77a80bfdf451 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.661053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-efb6271d-36dd-4607-8be2-c949ae24d194 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:52.662705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 283/572] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:52.668512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6271d-36dd-4607-8be2-c949ae24d194 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.669819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b45ea4-ab49-4ad4-a906-77a80bfdf451 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.674237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98252d17-1a28-442c-8f6b-bf3203e86cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.675098 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98252d17-1a28-442c-8f6b-bf3203e86cef admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.675381 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98252d17-1a28-442c-8f6b-bf3203e86cef admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.675702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98252d17-1a28-442c-8f6b-bf3203e86cef admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/a62aede1113047fc80983b85ae0cbfe2/roles/a22d2094a5364a8ba169d8e80f4402c5` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.680602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6271d-36dd-4607-8be2-c949ae24d194 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.686423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6725b-fe10-4348-b541-98c645e7d888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.687263 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6725b-fe10-4348-b541-98c645e7d888 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.687759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6725b-fe10-4348-b541-98c645e7d888 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.688042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6725b-fe10-4348-b541-98c645e7d888 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.688806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6725b-fe10-4348-b541-98c645e7d888 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.689116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6725b-fe10-4348-b541-98c645e7d888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.690728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6725b-fe10-4348-b541-98c645e7d888 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.693247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98252d17-1a28-442c-8f6b-bf3203e86cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=a62aede1113047fc80983b85ae0cbfe2, role_id=a22d2094a5364a8ba169d8e80f4402c5)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.695924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98252d17-1a28-442c-8f6b-bf3203e86cef admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.699412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 284/573] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.703907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6725b-fe10-4348-b541-98c645e7d888 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.712029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 290/574] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:52 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/a62aede1113047fc80983b85ae0cbfe2/roles/a22d2094a5364a8ba169d8e80f4402c5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:52.713867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6725b-fe10-4348-b541-98c645e7d888 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.721253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3ed9-b29f-453d-9a5e-549fa36ff017 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.721904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3ed9-b29f-453d-9a5e-549fa36ff017 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.722433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3ed9-b29f-453d-9a5e-549fa36ff017 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.728992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 291/575] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:52 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:52.730419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b3ed9-b29f-453d-9a5e-549fa36ff017 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.781540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52a260-2868-4dd2-a659-5ef330924ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.782383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a260-2868-4dd2-a659-5ef330924ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.782695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a260-2868-4dd2-a659-5ef330924ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.783490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52a260-2868-4dd2-a659-5ef330924ca1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.797714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a260-2868-4dd2-a659-5ef330924ca1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.799867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52a260-2868-4dd2-a659-5ef330924ca1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.805276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b3ed9-b29f-453d-9a5e-549fa36ff017 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.811284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bbb30-3665-44cd-bf78-2912412a1ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.812513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bbb30-3665-44cd-bf78-2912412a1ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.813107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bbb30-3665-44cd-bf78-2912412a1ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.813625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94bbb30-3665-44cd-bf78-2912412a1ef6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.820147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-2d52a260-2868-4dd2-a659-5ef330924ca1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:52.821589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 285/576] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:52.824326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6af58-d099-4ca3-9a52-86e413dab29a None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.824937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6af58-d099-4ca3-9a52-86e413dab29a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.825655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6af58-d099-4ca3-9a52-86e413dab29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.832667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bbb30-3665-44cd-bf78-2912412a1ef6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.835095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94bbb30-3665-44cd-bf78-2912412a1ef6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.850825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2ae6af58-d099-4ca3-9a52-86e413dab29a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:52.852095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2ae6af58-d099-4ca3-9a52-86e413dab29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:52.855818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-b94bbb30-3665-44cd-bf78-2912412a1ef6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:52.858327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 292/577] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:52.859825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bbb30-3665-44cd-bf78-2912412a1ef6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.860788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 286/578] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:52.867796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6af58-d099-4ca3-9a52-86e413dab29a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.880597 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94bbb30-3665-44cd-bf78-2912412a1ef6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.883469 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6af58-d099-4ca3-9a52-86e413dab29a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.886877 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7adc2-a277-48da-833f-d1203e9795b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.888658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7adc2-a277-48da-833f-d1203e9795b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.888658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7adc2-a277-48da-833f-d1203e9795b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.888890 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7adc2-a277-48da-833f-d1203e9795b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.890427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7adc2-a277-48da-833f-d1203e9795b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.890427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7adc2-a277-48da-833f-d1203e9795b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.893193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7adc2-a277-48da-833f-d1203e9795b7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.899621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd0bb5-3323-4fd8-91d0-fe9a715f6ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.900631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd0bb5-3323-4fd8-91d0-fe9a715f6ffc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.900917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd0bb5-3323-4fd8-91d0-fe9a715f6ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.901199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd0bb5-3323-4fd8-91d0-fe9a715f6ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.902387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd0bb5-3323-4fd8-91d0-fe9a715f6ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.902828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd0bb5-3323-4fd8-91d0-fe9a715f6ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.904943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd0bb5-3323-4fd8-91d0-fe9a715f6ffc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.907254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 293/579] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.907935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7adc2-a277-48da-833f-d1203e9795b7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.918338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7adc2-a277-48da-833f-d1203e9795b7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.921113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 287/580] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.921959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd0bb5-3323-4fd8-91d0-fe9a715f6ffc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.928396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53bb3c-42ac-4d13-b410-6b939b8666b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.929189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53bb3c-42ac-4d13-b410-6b939b8666b7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.929903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53bb3c-42ac-4d13-b410-6b939b8666b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.929903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53bb3c-42ac-4d13-b410-6b939b8666b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.933432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd0bb5-3323-4fd8-91d0-fe9a715f6ffc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.938992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb21ee-8f1c-4223-8f57-e00fee06a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.939809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb21ee-8f1c-4223-8f57-e00fee06a538 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.940098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb21ee-8f1c-4223-8f57-e00fee06a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.940391 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb21ee-8f1c-4223-8f57-e00fee06a538 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.946423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53bb3c-42ac-4d13-b410-6b939b8666b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:52.948459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb21ee-8f1c-4223-8f57-e00fee06a538 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.950567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb21ee-8f1c-4223-8f57-e00fee06a538 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.955899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-6f53bb3c-42ac-4d13-b410-6b939b8666b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:52.957660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 294/581] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:52.958729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53bb3c-42ac-4d13-b410-6b939b8666b7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.964241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-8cdb21ee-8f1c-4223-8f57-e00fee06a538 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 27 16:36:52.965436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 288/582] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:52.966490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb21ee-8f1c-4223-8f57-e00fee06a538 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:52.971016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53bb3c-42ac-4d13-b410-6b939b8666b7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.976064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb21ee-8f1c-4223-8f57-e00fee06a538 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:52.977330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671069d0-92cf-4198-a6ed-553f2a55fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.978638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671069d0-92cf-4198-a6ed-553f2a55fa62 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.979259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671069d0-92cf-4198-a6ed-553f2a55fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.979933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671069d0-92cf-4198-a6ed-553f2a55fa62 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.980895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9ff0-e9e5-454c-93be-1ef9536ebd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:52.982071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9ff0-e9e5-454c-93be-1ef9536ebd45 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:52.982361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9ff0-e9e5-454c-93be-1ef9536ebd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:52.982795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce9ff0-e9e5-454c-93be-1ef9536ebd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:52.983584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9ff0-e9e5-454c-93be-1ef9536ebd45 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:52.983921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9ff0-e9e5-454c-93be-1ef9536ebd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.985529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce9ff0-e9e5-454c-93be-1ef9536ebd45 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.991521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671069d0-92cf-4198-a6ed-553f2a55fa62 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:52.994242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 289/583] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:52.994441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671069d0-92cf-4198-a6ed-553f2a55fa62 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:52.995056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9ff0-e9e5-454c-93be-1ef9536ebd45 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.010467 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-671069d0-92cf-4198-a6ed-553f2a55fa62 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 27 16:36:53.012194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 295/584] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:53.013881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671069d0-92cf-4198-a6ed-553f2a55fa62 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.014404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce9ff0-e9e5-454c-93be-1ef9536ebd45 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.019222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374587c8-42bf-4458-9a7b-63549b4d2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.020046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374587c8-42bf-4458-9a7b-63549b4d2390 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.020648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374587c8-42bf-4458-9a7b-63549b4d2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.021037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374587c8-42bf-4458-9a7b-63549b4d2390 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.022556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374587c8-42bf-4458-9a7b-63549b4d2390 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.022958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374587c8-42bf-4458-9a7b-63549b4d2390 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.025350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374587c8-42bf-4458-9a7b-63549b4d2390 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.026194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671069d0-92cf-4198-a6ed-553f2a55fa62 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.032459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857e4d9-5c93-4dd2-89e8-c70da6b14a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.033743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857e4d9-5c93-4dd2-89e8-c70da6b14a68 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.034261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857e4d9-5c93-4dd2-89e8-c70da6b14a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.034722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857e4d9-5c93-4dd2-89e8-c70da6b14a68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.048553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857e4d9-5c93-4dd2-89e8-c70da6b14a68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.049006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 290/585] 10.222.0.48 () {56 vars in 1156 bytes} [Thu Jan 27 16:36:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.049937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374587c8-42bf-4458-9a7b-63549b4d2390 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.051253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857e4d9-5c93-4dd2-89e8-c70da6b14a68 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.066584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374587c8-42bf-4458-9a7b-63549b4d2390 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.071696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c71f-65c5-441c-9d5f-88858acfaaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.072485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c71f-65c5-441c-9d5f-88858acfaaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.072741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-2857e4d9-5c93-4dd2-89e8-c70da6b14a68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:53.072844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c71f-65c5-441c-9d5f-88858acfaaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.073193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32c71f-65c5-441c-9d5f-88858acfaaf6 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.074184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32c71f-65c5-441c-9d5f-88858acfaaf6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.074546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32c71f-65c5-441c-9d5f-88858acfaaf6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.074959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 296/586] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:53.076263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857e4d9-5c93-4dd2-89e8-c70da6b14a68 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.080993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32c71f-65c5-441c-9d5f-88858acfaaf6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.087639 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857e4d9-5c93-4dd2-89e8-c70da6b14a68 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.094194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f3f89-c5c6-4343-a1e6-1e0e3b896ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.095140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f3f89-c5c6-4343-a1e6-1e0e3b896ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.095686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f3f89-c5c6-4343-a1e6-1e0e3b896ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.096187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f3f89-c5c6-4343-a1e6-1e0e3b896ed7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.101744 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 291/587] 10.222.0.48 () {56 vars in 1160 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.102855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c71f-65c5-441c-9d5f-88858acfaaf6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.107004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f3f89-c5c6-4343-a1e6-1e0e3b896ed7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.109316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f3f89-c5c6-4343-a1e6-1e0e3b896ed7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.113785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32c71f-65c5-441c-9d5f-88858acfaaf6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.119406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cacbf0-f149-43e5-9663-d50bb84f8a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.120132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cacbf0-f149-43e5-9663-d50bb84f8a16 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.120420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cacbf0-f149-43e5-9663-d50bb84f8a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.120744 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cacbf0-f149-43e5-9663-d50bb84f8a16 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.121481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cacbf0-f149-43e5-9663-d50bb84f8a16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.121790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cacbf0-f149-43e5-9663-d50bb84f8a16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.122908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 297/588] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:53.124048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f3f89-c5c6-4343-a1e6-1e0e3b896ed7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.130591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cacbf0-f149-43e5-9663-d50bb84f8a16 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.134306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f3f89-c5c6-4343-a1e6-1e0e3b896ed7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.140338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a794f-ee93-49bc-a8ad-7b525f38a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.141861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a794f-ee93-49bc-a8ad-7b525f38a276 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.142593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a794f-ee93-49bc-a8ad-7b525f38a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.143053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a794f-ee93-49bc-a8ad-7b525f38a276 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.144491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 292/589] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.148280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cacbf0-f149-43e5-9663-d50bb84f8a16 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.159758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a794f-ee93-49bc-a8ad-7b525f38a276 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.162144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a794f-ee93-49bc-a8ad-7b525f38a276 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.162653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cacbf0-f149-43e5-9663-d50bb84f8a16 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.168096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3932c18-21b2-4c07-9777-a5c91e59fe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.169052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932c18-21b2-4c07-9777-a5c91e59fe70 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.169403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932c18-21b2-4c07-9777-a5c91e59fe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.169745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3932c18-21b2-4c07-9777-a5c91e59fe70 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.182060 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3932c18-21b2-4c07-9777-a5c91e59fe70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.183065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-ab8a794f-ee93-49bc-a8ad-7b525f38a276 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:53.184215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3932c18-21b2-4c07-9777-a5c91e59fe70 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.184838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 298/590] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:53.186059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a794f-ee93-49bc-a8ad-7b525f38a276 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.197536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a794f-ee93-49bc-a8ad-7b525f38a276 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.202833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0561c55-139d-4591-a50a-f74671a7314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.203545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-a3932c18-21b2-4c07-9777-a5c91e59fe70 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:53.203994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0561c55-139d-4591-a50a-f74671a7314e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.204424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0561c55-139d-4591-a50a-f74671a7314e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.204846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0561c55-139d-4591-a50a-f74671a7314e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.207655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 293/591] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:53.208591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3932c18-21b2-4c07-9777-a5c91e59fe70 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.217538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0561c55-139d-4591-a50a-f74671a7314e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.219816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0561c55-139d-4591-a50a-f74671a7314e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.224856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3932c18-21b2-4c07-9777-a5c91e59fe70 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.229543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d433-a7bd-4e4c-ab84-c932c01bf94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.230343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d433-a7bd-4e4c-ab84-c932c01bf94d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.230797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d433-a7bd-4e4c-ab84-c932c01bf94d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.231230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71d433-a7bd-4e4c-ab84-c932c01bf94d admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.232887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71d433-a7bd-4e4c-ab84-c932c01bf94d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.233344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71d433-a7bd-4e4c-ab84-c932c01bf94d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.235071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71d433-a7bd-4e4c-ab84-c932c01bf94d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.235440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-c0561c55-139d-4591-a50a-f74671a7314e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 27 16:36:53.236845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 299/592] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:53.242276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0561c55-139d-4591-a50a-f74671a7314e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.249539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 294/593] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.250596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d433-a7bd-4e4c-ab84-c932c01bf94d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.253028 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0561c55-139d-4591-a50a-f74671a7314e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.257919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a2b87-8fff-47f4-b619-ba31059dc2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.258458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a2b87-8fff-47f4-b619-ba31059dc2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.258841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a2b87-8fff-47f4-b619-ba31059dc2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.259218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a2b87-8fff-47f4-b619-ba31059dc2e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.260108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a2b87-8fff-47f4-b619-ba31059dc2e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.260529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a2b87-8fff-47f4-b619-ba31059dc2e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.262231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a2b87-8fff-47f4-b619-ba31059dc2e5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.262533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71d433-a7bd-4e4c-ab84-c932c01bf94d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.267786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8010e92-608e-44ab-9bdd-569d08776f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.268656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8010e92-608e-44ab-9bdd-569d08776f0a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.269120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8010e92-608e-44ab-9bdd-569d08776f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.269573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8010e92-608e-44ab-9bdd-569d08776f0a admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.270597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8010e92-608e-44ab-9bdd-569d08776f0a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.271076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8010e92-608e-44ab-9bdd-569d08776f0a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.273299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8010e92-608e-44ab-9bdd-569d08776f0a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.281419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 300/594] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.282438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a2b87-8fff-47f4-b619-ba31059dc2e5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.292522 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a2b87-8fff-47f4-b619-ba31059dc2e5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.293924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 295/595] 10.222.0.48 () {56 vars in 1158 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.295206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8010e92-608e-44ab-9bdd-569d08776f0a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.301678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6082b7-8c89-4e5c-ac59-96742051ca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.302484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6082b7-8c89-4e5c-ac59-96742051ca4b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.302799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6082b7-8c89-4e5c-ac59-96742051ca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.303079 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6082b7-8c89-4e5c-ac59-96742051ca4b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.308705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8010e92-608e-44ab-9bdd-569d08776f0a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.311681 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6082b7-8c89-4e5c-ac59-96742051ca4b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.313913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6082b7-8c89-4e5c-ac59-96742051ca4b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.314856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e2f4e-6003-475b-a1ce-7c6615c5337a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.315925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e2f4e-6003-475b-a1ce-7c6615c5337a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.316413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e2f4e-6003-475b-a1ce-7c6615c5337a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.316890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e2f4e-6003-475b-a1ce-7c6615c5337a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.324172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e2f4e-6003-475b-a1ce-7c6615c5337a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.326477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e2f4e-6003-475b-a1ce-7c6615c5337a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.328034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-2b6082b7-8c89-4e5c-ac59-96742051ca4b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:53.329215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 301/596] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:53.329973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6082b7-8c89-4e5c-ac59-96742051ca4b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.340508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6082b7-8c89-4e5c-ac59-96742051ca4b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.342230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-092e2f4e-6003-475b-a1ce-7c6615c5337a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:53.343979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 296/597] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:53.345204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e2f4e-6003-475b-a1ce-7c6615c5337a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.352796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f149c1-887e-4e9a-a09e-6bd8490a9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.353647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f149c1-887e-4e9a-a09e-6bd8490a9350 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.353946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f149c1-887e-4e9a-a09e-6bd8490a9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.354326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f149c1-887e-4e9a-a09e-6bd8490a9350 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.359676 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e2f4e-6003-475b-a1ce-7c6615c5337a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.364489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74864-dc57-4c3d-a331-6c53482e7b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.365377 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74864-dc57-4c3d-a331-6c53482e7b49 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.365873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74864-dc57-4c3d-a331-6c53482e7b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.365997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f149c1-887e-4e9a-a09e-6bd8490a9350 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.366466 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e74864-dc57-4c3d-a331-6c53482e7b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.367456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e74864-dc57-4c3d-a331-6c53482e7b49 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.367964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f149c1-887e-4e9a-a09e-6bd8490a9350 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.368204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e74864-dc57-4c3d-a331-6c53482e7b49 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.370404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e74864-dc57-4c3d-a331-6c53482e7b49 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.383384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 297/598] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.384665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74864-dc57-4c3d-a331-6c53482e7b49 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.386010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-67f149c1-887e-4e9a-a09e-6bd8490a9350 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:53.387318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 302/599] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:53.392681 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f149c1-887e-4e9a-a09e-6bd8490a9350 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.396184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e74864-dc57-4c3d-a331-6c53482e7b49 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.401297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb933b-a132-48f4-94bf-5cacd31b7ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.402179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb933b-a132-48f4-94bf-5cacd31b7ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.402664 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb933b-a132-48f4-94bf-5cacd31b7ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.402985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f149c1-887e-4e9a-a09e-6bd8490a9350 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.403936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb933b-a132-48f4-94bf-5cacd31b7ee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.404938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb933b-a132-48f4-94bf-5cacd31b7ee7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.405546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb933b-a132-48f4-94bf-5cacd31b7ee7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.407902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb933b-a132-48f4-94bf-5cacd31b7ee7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.408602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3884c0-05ed-4078-ac53-16a3e14f1136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.409472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3884c0-05ed-4078-ac53-16a3e14f1136 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.409803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3884c0-05ed-4078-ac53-16a3e14f1136 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.410082 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3884c0-05ed-4078-ac53-16a3e14f1136 admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/15ae418635734639a4d10676978e82cf/roles/a22d2094a5364a8ba169d8e80f4402c5` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.422834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 298/600] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.424085 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb933b-a132-48f4-94bf-5cacd31b7ee7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.435406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3884c0-05ed-4078-ac53-16a3e14f1136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=15ae418635734639a4d10676978e82cf, role_id=a22d2094a5364a8ba169d8e80f4402c5)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.438284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3884c0-05ed-4078-ac53-16a3e14f1136 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.440327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb933b-a132-48f4-94bf-5cacd31b7ee7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.445969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2293a-a010-4bf5-9f7d-db4122ee3278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.447061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2293a-a010-4bf5-9f7d-db4122ee3278 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.447663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2293a-a010-4bf5-9f7d-db4122ee3278 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.448167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2293a-a010-4bf5-9f7d-db4122ee3278 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.449156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2293a-a010-4bf5-9f7d-db4122ee3278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.449698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2293a-a010-4bf5-9f7d-db4122ee3278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.451921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2293a-a010-4bf5-9f7d-db4122ee3278 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.455196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 303/601] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:53 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/15ae418635734639a4d10676978e82cf/roles/a22d2094a5364a8ba169d8e80f4402c5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:53.455832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3884c0-05ed-4078-ac53-16a3e14f1136 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.465626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 299/602] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.472964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2293a-a010-4bf5-9f7d-db4122ee3278 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.485234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2293a-a010-4bf5-9f7d-db4122ee3278 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.537213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3884c0-05ed-4078-ac53-16a3e14f1136 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.547188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f93e97-3bca-430e-be1f-4da7e63b23ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.547920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93e97-3bca-430e-be1f-4da7e63b23ae admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.548269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93e97-3bca-430e-be1f-4da7e63b23ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.548552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93e97-3bca-430e-be1f-4da7e63b23ae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.549470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f93e97-3bca-430e-be1f-4da7e63b23ae admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=e14c278fc5654bb9ae7c05d4ba023262) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.549789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f93e97-3bca-430e-be1f-4da7e63b23ae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.551894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f93e97-3bca-430e-be1f-4da7e63b23ae admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.558634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 304/603] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/role_assignments?user.id=e14c278fc5654bb9ae7c05d4ba023262&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 259 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.573201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f10d6-7915-4f56-8867-f7b8edc55683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.574094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f10d6-7915-4f56-8867-f7b8edc55683 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.574444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f10d6-7915-4f56-8867-f7b8edc55683 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.574730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f10d6-7915-4f56-8867-f7b8edc55683 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.583751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f10d6-7915-4f56-8867-f7b8edc55683 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.585803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f10d6-7915-4f56-8867-f7b8edc55683 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.602126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c03f10d6-7915-4f56-8867-f7b8edc55683 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:53.603792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 300/604] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 132 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:53.610081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f93e97-3bca-430e-be1f-4da7e63b23ae admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.621622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f93e97-3bca-430e-be1f-4da7e63b23ae admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.627809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0870e7-feba-4fc5-a947-5d6e799cf621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.628838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0870e7-feba-4fc5-a947-5d6e799cf621 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.629327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0870e7-feba-4fc5-a947-5d6e799cf621 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.629844 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0870e7-feba-4fc5-a947-5d6e799cf621 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.630878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0870e7-feba-4fc5-a947-5d6e799cf621 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:53.631398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0870e7-feba-4fc5-a947-5d6e799cf621 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.633587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0870e7-feba-4fc5-a947-5d6e799cf621 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.647524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 305/605] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:53.655021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f10d6-7915-4f56-8867-f7b8edc55683 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:53.670781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f10d6-7915-4f56-8867-f7b8edc55683 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:53.676067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383507a-2572-45d0-9aaa-689684bbab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:53.677287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383507a-2572-45d0-9aaa-689684bbab8d admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:53.677772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383507a-2572-45d0-9aaa-689684bbab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:53.678278 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383507a-2572-45d0-9aaa-689684bbab8d admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/295fe8f61f87423bb49471e2f0085690/roles/a22d2094a5364a8ba169d8e80f4402c5` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:53.704721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383507a-2572-45d0-9aaa-689684bbab8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=295fe8f61f87423bb49471e2f0085690, role_id=a22d2094a5364a8ba169d8e80f4402c5)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:53.707868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383507a-2572-45d0-9aaa-689684bbab8d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:53.724508 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 301/606] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:53 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/295fe8f61f87423bb49471e2f0085690/roles/a22d2094a5364a8ba169d8e80f4402c5 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:54.684386 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be2c7-fc8e-424e-8469-cf0597200265 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:54.685981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be2c7-fc8e-424e-8469-cf0597200265 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:54.686479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04be2c7-fc8e-424e-8469-cf0597200265 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:54.688741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 306/607] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:54.693742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bb3a-d82a-40f1-808c-657755eca3e3 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:54.694583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bb3a-d82a-40f1-808c-657755eca3e3 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:54.695061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4bb3a-d82a-40f1-808c-657755eca3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:54.720570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-87e4bb3a-d82a-40f1-808c-657755eca3e3 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:54.722102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-87e4bb3a-d82a-40f1-808c-657755eca3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:54.795992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 302/608] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:54.840026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be2c7-fc8e-424e-8469-cf0597200265 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:54.861106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04be2c7-fc8e-424e-8469-cf0597200265 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:54.868587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935022ba-8db4-4592-8eeb-97b5da1106a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:54.869547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935022ba-8db4-4592-8eeb-97b5da1106a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:54.869974 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935022ba-8db4-4592-8eeb-97b5da1106a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:54.870494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935022ba-8db4-4592-8eeb-97b5da1106a2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:54.882483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935022ba-8db4-4592-8eeb-97b5da1106a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:54.893768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-935022ba-8db4-4592-8eeb-97b5da1106a2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:54.895665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 307/609] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:54.901342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4bb3a-d82a-40f1-808c-657755eca3e3 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:54.917016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4bb3a-d82a-40f1-808c-657755eca3e3 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:54.926612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4192-b55e-4b8e-abb9-b8491a0205ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:54.931931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4192-b55e-4b8e-abb9-b8491a0205ba admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:54.932244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4192-b55e-4b8e-abb9-b8491a0205ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:54.932533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4192-b55e-4b8e-abb9-b8491a0205ba admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:54.933326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4192-b55e-4b8e-abb9-b8491a0205ba admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:54.933641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4192-b55e-4b8e-abb9-b8491a0205ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:54.935818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4192-b55e-4b8e-abb9-b8491a0205ba admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:54.944555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 303/610] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:54.949746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935022ba-8db4-4592-8eeb-97b5da1106a2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:54.965576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935022ba-8db4-4592-8eeb-97b5da1106a2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:54.973004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c23a2-7589-4b25-9fd6-efdcdb281ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:54.974071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c23a2-7589-4b25-9fd6-efdcdb281ecc admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:54.974603 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c23a2-7589-4b25-9fd6-efdcdb281ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:54.975111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c23a2-7589-4b25-9fd6-efdcdb281ecc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:54.990237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c23a2-7589-4b25-9fd6-efdcdb281ecc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:54.992517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c23a2-7589-4b25-9fd6-efdcdb281ecc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.017516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-698c23a2-7589-4b25-9fd6-efdcdb281ecc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:55.019317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 308/611] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:55.024586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4192-b55e-4b8e-abb9-b8491a0205ba admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.046565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4192-b55e-4b8e-abb9-b8491a0205ba admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.052354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d2646-27c3-436d-b254-88b71b6e91f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.053557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d2646-27c3-436d-b254-88b71b6e91f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.054117 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d2646-27c3-436d-b254-88b71b6e91f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.054615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446d2646-27c3-436d-b254-88b71b6e91f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.055662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d2646-27c3-436d-b254-88b71b6e91f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:55.056189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d2646-27c3-436d-b254-88b71b6e91f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.058102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446d2646-27c3-436d-b254-88b71b6e91f5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.074655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 304/612] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:55.081137 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c23a2-7589-4b25-9fd6-efdcdb281ecc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.091685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c23a2-7589-4b25-9fd6-efdcdb281ecc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.099737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c6ac2-f477-4f88-8662-e4449d0779f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.100832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c6ac2-f477-4f88-8662-e4449d0779f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.101313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c6ac2-f477-4f88-8662-e4449d0779f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.101836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c6ac2-f477-4f88-8662-e4449d0779f8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.110069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c6ac2-f477-4f88-8662-e4449d0779f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.112376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c6ac2-f477-4f88-8662-e4449d0779f8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.131656 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-d20c6ac2-f477-4f88-8662-e4449d0779f8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 27 16:36:55.133130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 309/613] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:55.139261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d2646-27c3-436d-b254-88b71b6e91f5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.151050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446d2646-27c3-436d-b254-88b71b6e91f5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.158086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775a95e-47cc-4d86-8eaa-b8003a4e8a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.159284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775a95e-47cc-4d86-8eaa-b8003a4e8a12 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.159835 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775a95e-47cc-4d86-8eaa-b8003a4e8a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.160321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775a95e-47cc-4d86-8eaa-b8003a4e8a12 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.161437 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775a95e-47cc-4d86-8eaa-b8003a4e8a12 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:55.161943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775a95e-47cc-4d86-8eaa-b8003a4e8a12 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.164131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775a95e-47cc-4d86-8eaa-b8003a4e8a12 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.188359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 305/614] 10.222.0.48 () {56 vars in 1154 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:55.194373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c6ac2-f477-4f88-8662-e4449d0779f8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.205544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c6ac2-f477-4f88-8662-e4449d0779f8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.210452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58995f9-a91f-46ea-83c2-c131e05f2bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.211331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58995f9-a91f-46ea-83c2-c131e05f2bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.211863 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58995f9-a91f-46ea-83c2-c131e05f2bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.212344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58995f9-a91f-46ea-83c2-c131e05f2bf8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.222126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58995f9-a91f-46ea-83c2-c131e05f2bf8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.225806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58995f9-a91f-46ea-83c2-c131e05f2bf8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.236262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 310/615] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:55.244644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775a95e-47cc-4d86-8eaa-b8003a4e8a12 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.258492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775a95e-47cc-4d86-8eaa-b8003a4e8a12 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.265516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc99a7b-dbc0-4c95-9340-3c5ee1c2311b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.266601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc99a7b-dbc0-4c95-9340-3c5ee1c2311b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.267149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc99a7b-dbc0-4c95-9340-3c5ee1c2311b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.267661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc99a7b-dbc0-4c95-9340-3c5ee1c2311b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.282877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc99a7b-dbc0-4c95-9340-3c5ee1c2311b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.285260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc99a7b-dbc0-4c95-9340-3c5ee1c2311b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.304915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-2dc99a7b-dbc0-4c95-9340-3c5ee1c2311b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:55.306378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 306/616] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:55.312145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58995f9-a91f-46ea-83c2-c131e05f2bf8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.321575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58995f9-a91f-46ea-83c2-c131e05f2bf8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.327081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158948db-025f-4b59-9b9d-4ec25f3c4bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.328040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158948db-025f-4b59-9b9d-4ec25f3c4bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.328610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158948db-025f-4b59-9b9d-4ec25f3c4bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.329099 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158948db-025f-4b59-9b9d-4ec25f3c4bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.330151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158948db-025f-4b59-9b9d-4ec25f3c4bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:55.330687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158948db-025f-4b59-9b9d-4ec25f3c4bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.332538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158948db-025f-4b59-9b9d-4ec25f3c4bc9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.346000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 311/617] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:55.352741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc99a7b-dbc0-4c95-9340-3c5ee1c2311b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.364711 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc99a7b-dbc0-4c95-9340-3c5ee1c2311b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.371763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6672fe-dc2b-4e76-afdd-9b42307ba367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.372952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6672fe-dc2b-4e76-afdd-9b42307ba367 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.373495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6672fe-dc2b-4e76-afdd-9b42307ba367 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.373986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6672fe-dc2b-4e76-afdd-9b42307ba367 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.385741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6672fe-dc2b-4e76-afdd-9b42307ba367 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.388962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6672fe-dc2b-4e76-afdd-9b42307ba367 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.410475 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-6a6672fe-dc2b-4e76-afdd-9b42307ba367 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:55.412071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 307/618] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:55.418144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158948db-025f-4b59-9b9d-4ec25f3c4bc9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.429202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158948db-025f-4b59-9b9d-4ec25f3c4bc9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.440049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a08eb-7303-447c-b4f6-d1115f28c17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.441108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a08eb-7303-447c-b4f6-d1115f28c17d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.441642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a08eb-7303-447c-b4f6-d1115f28c17d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.442112 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a08eb-7303-447c-b4f6-d1115f28c17d admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.443183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a08eb-7303-447c-b4f6-d1115f28c17d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:55.443797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a08eb-7303-447c-b4f6-d1115f28c17d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.445911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a08eb-7303-447c-b4f6-d1115f28c17d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.460475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 312/619] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:55.467680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6672fe-dc2b-4e76-afdd-9b42307ba367 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.491423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6672fe-dc2b-4e76-afdd-9b42307ba367 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.503616 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3c5f2-dda0-4bdb-89c7-020492a2bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.503616 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c5f2-dda0-4bdb-89c7-020492a2bdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.503616 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c5f2-dda0-4bdb-89c7-020492a2bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.503616 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3c5f2-dda0-4bdb-89c7-020492a2bdb1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.504021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3c5f2-dda0-4bdb-89c7-020492a2bdb1 admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=8500a8d242bf43a9b2fd538c3b1bb037) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:55.504272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3c5f2-dda0-4bdb-89c7-020492a2bdb1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.506184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e3c5f2-dda0-4bdb-89c7-020492a2bdb1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.516829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 308/620] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/role_assignments?user.id=8500a8d242bf43a9b2fd538c3b1bb037&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:55.692202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba991a-b41c-40d6-bfb8-9a9d58d903e0 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.692713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba991a-b41c-40d6-bfb8-9a9d58d903e0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.692713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba991a-b41c-40d6-bfb8-9a9d58d903e0 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.694939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 313/621] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:55.701360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383ee1-aae9-485d-9015-aea243e787a9 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.701881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383ee1-aae9-485d-9015-aea243e787a9 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.701881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d383ee1-aae9-485d-9015-aea243e787a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.736161 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2d383ee1-aae9-485d-9015-aea243e787a9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:55.737373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2d383ee1-aae9-485d-9015-aea243e787a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:55.751961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 309/622] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:55.781417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba991a-b41c-40d6-bfb8-9a9d58d903e0 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.796115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba991a-b41c-40d6-bfb8-9a9d58d903e0 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.802634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325abe9f-54c1-420e-8b21-0353a12f4cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.803711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325abe9f-54c1-420e-8b21-0353a12f4cdf admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.804265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325abe9f-54c1-420e-8b21-0353a12f4cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.804753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325abe9f-54c1-420e-8b21-0353a12f4cdf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.821017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325abe9f-54c1-420e-8b21-0353a12f4cdf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:55.829115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-325abe9f-54c1-420e-8b21-0353a12f4cdf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:55.830744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 314/623] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:55.836778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383ee1-aae9-485d-9015-aea243e787a9 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.847851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d383ee1-aae9-485d-9015-aea243e787a9 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.852653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d1c4e-5a79-4619-8e11-3ca4fb29da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.853544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d1c4e-5a79-4619-8e11-3ca4fb29da6f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.854438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d1c4e-5a79-4619-8e11-3ca4fb29da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.854921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d1c4e-5a79-4619-8e11-3ca4fb29da6f admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.856099 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d1c4e-5a79-4619-8e11-3ca4fb29da6f admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:55.856779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d1c4e-5a79-4619-8e11-3ca4fb29da6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.858588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d1c4e-5a79-4619-8e11-3ca4fb29da6f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.871690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 310/624] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:55.874391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325abe9f-54c1-420e-8b21-0353a12f4cdf admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.885801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325abe9f-54c1-420e-8b21-0353a12f4cdf admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.891347 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d102f18-ac76-430b-88ed-f1f330525ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.892439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d102f18-ac76-430b-88ed-f1f330525ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.892928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d102f18-ac76-430b-88ed-f1f330525ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.893451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d102f18-ac76-430b-88ed-f1f330525ff4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.905571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d102f18-ac76-430b-88ed-f1f330525ff4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.907796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d102f18-ac76-430b-88ed-f1f330525ff4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.925956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-0d102f18-ac76-430b-88ed-f1f330525ff4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:55.931700 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 315/625] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:55.933861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d1c4e-5a79-4619-8e11-3ca4fb29da6f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.945153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d1c4e-5a79-4619-8e11-3ca4fb29da6f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.950073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4df722-c620-4b79-b7d4-bd87a04f2e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.951195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4df722-c620-4b79-b7d4-bd87a04f2e43 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.951885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4df722-c620-4b79-b7d4-bd87a04f2e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.952372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4df722-c620-4b79-b7d4-bd87a04f2e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:55.953457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4df722-c620-4b79-b7d4-bd87a04f2e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:55.953966 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4df722-c620-4b79-b7d4-bd87a04f2e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:55.955854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4df722-c620-4b79-b7d4-bd87a04f2e43 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:55.971701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 311/626] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:55.975236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d102f18-ac76-430b-88ed-f1f330525ff4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:55.986405 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d102f18-ac76-430b-88ed-f1f330525ff4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:55.991370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd718442-fc9d-4c86-afd1-df71a2d8b714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:55.992462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718442-fc9d-4c86-afd1-df71a2d8b714 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:55.992950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718442-fc9d-4c86-afd1-df71a2d8b714 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:55.993481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd718442-fc9d-4c86-afd1-df71a2d8b714 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.003261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd718442-fc9d-4c86-afd1-df71a2d8b714 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.005686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd718442-fc9d-4c86-afd1-df71a2d8b714 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.020808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-fd718442-fc9d-4c86-afd1-df71a2d8b714 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 27 16:36:56.025117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 316/627] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:56.028644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4df722-c620-4b79-b7d4-bd87a04f2e43 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.039766 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c24d-cc01-446c-839f-a69f58a8e6c6 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.040480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c24d-cc01-446c-839f-a69f58a8e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.040970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2c24d-cc01-446c-839f-a69f58a8e6c6 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.043367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 317/628] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:36:56.045543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4df722-c620-4b79-b7d4-bd87a04f2e43 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.051755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e3bde-60fd-4360-a4c5-35f16a30cbea None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.052430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e3bde-60fd-4360-a4c5-35f16a30cbea None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.053072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e3bde-60fd-4360-a4c5-35f16a30cbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.054804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630b132-887a-41ca-86d9-4b25afcafcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.055453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630b132-887a-41ca-86d9-4b25afcafcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.055753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630b132-887a-41ca-86d9-4b25afcafcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.056030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630b132-887a-41ca-86d9-4b25afcafcb6 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.056921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630b132-887a-41ca-86d9-4b25afcafcb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.057256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630b132-887a-41ca-86d9-4b25afcafcb6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.059099 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630b132-887a-41ca-86d9-4b25afcafcb6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.078874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b75e3bde-60fd-4360-a4c5-35f16a30cbea None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:56.079622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 312/629] 10.222.0.48 () {56 vars in 1158 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:56.085670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b75e3bde-60fd-4360-a4c5-35f16a30cbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:56.093339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 318/630] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:56.094928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630b132-887a-41ca-86d9-4b25afcafcb6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.105840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630b132-887a-41ca-86d9-4b25afcafcb6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.110805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc68f7-25fc-4580-b078-8bf4a0644663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.111478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc68f7-25fc-4580-b078-8bf4a0644663 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.111800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc68f7-25fc-4580-b078-8bf4a0644663 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.112084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc68f7-25fc-4580-b078-8bf4a0644663 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.124718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc68f7-25fc-4580-b078-8bf4a0644663 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.126708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e3bde-60fd-4360-a4c5-35f16a30cbea None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.127973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc68f7-25fc-4580-b078-8bf4a0644663 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.136834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e3bde-60fd-4360-a4c5-35f16a30cbea None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.139482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 313/631] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:56.146845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db902227-6432-4224-9309-c39a38540a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.147690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db902227-6432-4224-9309-c39a38540a25 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.147979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db902227-6432-4224-9309-c39a38540a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.148258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db902227-6432-4224-9309-c39a38540a25 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.148357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc68f7-25fc-4580-b078-8bf4a0644663 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.158687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc68f7-25fc-4580-b078-8bf4a0644663 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.161052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db902227-6432-4224-9309-c39a38540a25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:56.169162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-db902227-6432-4224-9309-c39a38540a25 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:56.170044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc2c12-befb-4138-af79-b19990acdd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.170304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 319/632] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:56.171249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc2c12-befb-4138-af79-b19990acdd40 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.171536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc2c12-befb-4138-af79-b19990acdd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.175910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc2c12-befb-4138-af79-b19990acdd40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.177303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db902227-6432-4224-9309-c39a38540a25 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.191363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc2c12-befb-4138-af79-b19990acdd40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.191363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc2c12-befb-4138-af79-b19990acdd40 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.195245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db902227-6432-4224-9309-c39a38540a25 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.214625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-e6cc2c12-befb-4138-af79-b19990acdd40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:56.218881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fe42d-e711-4aff-8d2d-51c45885fb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.219553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fe42d-e711-4aff-8d2d-51c45885fb5e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.219857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fe42d-e711-4aff-8d2d-51c45885fb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.220130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fe42d-e711-4aff-8d2d-51c45885fb5e admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.220895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fe42d-e711-4aff-8d2d-51c45885fb5e admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.221204 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fe42d-e711-4aff-8d2d-51c45885fb5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.222805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fe42d-e711-4aff-8d2d-51c45885fb5e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.225456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 314/633] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:56.234208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc2c12-befb-4138-af79-b19990acdd40 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.242127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 320/634] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:56.249275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fe42d-e711-4aff-8d2d-51c45885fb5e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.257449 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc2c12-befb-4138-af79-b19990acdd40 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.264446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fe42d-e711-4aff-8d2d-51c45885fb5e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.267554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8622b-da7a-4711-ad08-f054bddf0c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.268244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8622b-da7a-4711-ad08-f054bddf0c75 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.268524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8622b-da7a-4711-ad08-f054bddf0c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.268799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8622b-da7a-4711-ad08-f054bddf0c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.269533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8622b-da7a-4711-ad08-f054bddf0c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.269899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8622b-da7a-4711-ad08-f054bddf0c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.271512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8622b-da7a-4711-ad08-f054bddf0c75 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.283087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdab02-8994-4441-ac2a-cdc959d86292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.284201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdab02-8994-4441-ac2a-cdc959d86292 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.284490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdab02-8994-4441-ac2a-cdc959d86292 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.284763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfdab02-8994-4441-ac2a-cdc959d86292 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.292275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 315/635] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:56.301329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8622b-da7a-4711-ad08-f054bddf0c75 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.309314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdab02-8994-4441-ac2a-cdc959d86292 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.311728 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfdab02-8994-4441-ac2a-cdc959d86292 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.318886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8622b-da7a-4711-ad08-f054bddf0c75 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.335422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-cdfdab02-8994-4441-ac2a-cdc959d86292 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:56.338053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3492b2-7c7e-414e-8e5d-7281d2ef1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.338843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3492b2-7c7e-414e-8e5d-7281d2ef1758 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.339122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3492b2-7c7e-414e-8e5d-7281d2ef1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.339391 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3492b2-7c7e-414e-8e5d-7281d2ef1758 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.347356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3492b2-7c7e-414e-8e5d-7281d2ef1758 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.348675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 321/636] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:56.349343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3492b2-7c7e-414e-8e5d-7281d2ef1758 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.355144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdab02-8994-4441-ac2a-cdc959d86292 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.368129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-2e3492b2-7c7e-414e-8e5d-7281d2ef1758 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:56.368502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfdab02-8994-4441-ac2a-cdc959d86292 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.369620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 316/637] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:56.376241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3492b2-7c7e-414e-8e5d-7281d2ef1758 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.379054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cb66c-2bb6-4dec-939e-2323f9ff4647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.379796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cb66c-2bb6-4dec-939e-2323f9ff4647 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.380088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cb66c-2bb6-4dec-939e-2323f9ff4647 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.380368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cb66c-2bb6-4dec-939e-2323f9ff4647 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.381124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cb66c-2bb6-4dec-939e-2323f9ff4647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.381434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cb66c-2bb6-4dec-939e-2323f9ff4647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.383044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cb66c-2bb6-4dec-939e-2323f9ff4647 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.386727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3492b2-7c7e-414e-8e5d-7281d2ef1758 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.392007 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26741e37-0f47-4619-a1f7-fd24c0d1457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.392652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741e37-0f47-4619-a1f7-fd24c0d1457b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.392931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741e37-0f47-4619-a1f7-fd24c0d1457b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.393206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26741e37-0f47-4619-a1f7-fd24c0d1457b admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.393996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26741e37-0f47-4619-a1f7-fd24c0d1457b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.394301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26741e37-0f47-4619-a1f7-fd24c0d1457b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.396194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26741e37-0f47-4619-a1f7-fd24c0d1457b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.396567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 322/638] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:56.397921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3a8b0-8aa9-4796-bbba-d209560d4a09 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.398214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3a8b0-8aa9-4796-bbba-d209560d4a09 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.398571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3a8b0-8aa9-4796-bbba-d209560d4a09 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.400607 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 323/639] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:56.405857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3a8b0-8aa9-4796-bbba-d209560d4a09 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.413140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 317/640] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:56.414475 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ef542-6b0b-40e5-8f99-d56ea20df044 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.414758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ef542-6b0b-40e5-8f99-d56ea20df044 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.415031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ef542-6b0b-40e5-8f99-d56ea20df044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.420196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3a8b0-8aa9-4796-bbba-d209560d4a09 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.426021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08561f-1767-4914-90d7-c494b8c58aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.426822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08561f-1767-4914-90d7-c494b8c58aea admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.427157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08561f-1767-4914-90d7-c494b8c58aea admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.428060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08561f-1767-4914-90d7-c494b8c58aea admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.432937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9e8ef542-6b0b-40e5-8f99-d56ea20df044 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:56.434143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9e8ef542-6b0b-40e5-8f99-d56ea20df044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:56.438311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08561f-1767-4914-90d7-c494b8c58aea admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.441028 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c08561f-1767-4914-90d7-c494b8c58aea admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.443092 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 318/641] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:56.444065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ef542-6b0b-40e5-8f99-d56ea20df044 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.453918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ef542-6b0b-40e5-8f99-d56ea20df044 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.458769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71173-4c75-4819-a1aa-d61a2af7c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.459578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71173-4c75-4819-a1aa-d61a2af7c903 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.459952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71173-4c75-4819-a1aa-d61a2af7c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.460290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c71173-4c75-4819-a1aa-d61a2af7c903 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.461208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c71173-4c75-4819-a1aa-d61a2af7c903 admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=a62aede1113047fc80983b85ae0cbfe2) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.461585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c71173-4c75-4819-a1aa-d61a2af7c903 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.463604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c71173-4c75-4819-a1aa-d61a2af7c903 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.469477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-6c08561f-1767-4914-90d7-c494b8c58aea admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 27 16:36:56.470733 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 324/642] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:56.476483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08561f-1767-4914-90d7-c494b8c58aea admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.478709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 319/643] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/role_assignments?user.id=a62aede1113047fc80983b85ae0cbfe2&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:56.485450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71173-4c75-4819-a1aa-d61a2af7c903 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.486956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08561f-1767-4914-90d7-c494b8c58aea admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.504242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c71173-4c75-4819-a1aa-d61a2af7c903 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.507019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f2a7d-76ae-4666-bc60-cbf54786a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.507751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f2a7d-76ae-4666-bc60-cbf54786a182 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.508079 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f2a7d-76ae-4666-bc60-cbf54786a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.508355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f2a7d-76ae-4666-bc60-cbf54786a182 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.509272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f2a7d-76ae-4666-bc60-cbf54786a182 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.509987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f2a7d-76ae-4666-bc60-cbf54786a182 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.512894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f2a7d-76ae-4666-bc60-cbf54786a182 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.520423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3964f-de0c-4825-81cf-9dd8b735f93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.521289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3964f-de0c-4825-81cf-9dd8b735f93a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.521570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3964f-de0c-4825-81cf-9dd8b735f93a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.521846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3964f-de0c-4825-81cf-9dd8b735f93a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.548155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3964f-de0c-4825-81cf-9dd8b735f93a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:56.557114 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-81a3964f-de0c-4825-81cf-9dd8b735f93a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:56.563186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 325/644] 10.222.0.48 () {56 vars in 1156 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:56.564114 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 320/645] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:56.568540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f2a7d-76ae-4666-bc60-cbf54786a182 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.573031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3964f-de0c-4825-81cf-9dd8b735f93a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.589180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f2a7d-76ae-4666-bc60-cbf54786a182 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.593106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3964f-de0c-4825-81cf-9dd8b735f93a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.598558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea83f1-1226-453c-ae4f-60dee36e1c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.599828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea83f1-1226-453c-ae4f-60dee36e1c19 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.600113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea83f1-1226-453c-ae4f-60dee36e1c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.600389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea83f1-1226-453c-ae4f-60dee36e1c19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.611380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4fc0f-b9aa-47e4-8eab-ff753d7dc73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.612382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4fc0f-b9aa-47e4-8eab-ff753d7dc73c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.612664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea83f1-1226-453c-ae4f-60dee36e1c19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.612833 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4fc0f-b9aa-47e4-8eab-ff753d7dc73c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.612979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4fc0f-b9aa-47e4-8eab-ff753d7dc73c admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.613699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4fc0f-b9aa-47e4-8eab-ff753d7dc73c admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.614008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4fc0f-b9aa-47e4-8eab-ff753d7dc73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.614679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea83f1-1226-453c-ae4f-60dee36e1c19 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.615631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4fc0f-b9aa-47e4-8eab-ff753d7dc73c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.634052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 321/646] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:56.639932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4fc0f-b9aa-47e4-8eab-ff753d7dc73c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.647836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-7eea83f1-1226-453c-ae4f-60dee36e1c19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:56.652875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4fc0f-b9aa-47e4-8eab-ff753d7dc73c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.655147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 326/647] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:56.660872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea83f1-1226-453c-ae4f-60dee36e1c19 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.663134 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71390459-b697-4b99-826e-8e652ff6b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.663134 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71390459-b697-4b99-826e-8e652ff6b683 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.664025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71390459-b697-4b99-826e-8e652ff6b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.664482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71390459-b697-4b99-826e-8e652ff6b683 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.677126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71390459-b697-4b99-826e-8e652ff6b683 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.679297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71390459-b697-4b99-826e-8e652ff6b683 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.681718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea83f1-1226-453c-ae4f-60dee36e1c19 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.698315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-71390459-b697-4b99-826e-8e652ff6b683 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:56.700767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 322/648] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:56.702068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ce536-fddc-4742-acde-eb8b7768c5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.702755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ce536-fddc-4742-acde-eb8b7768c5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.703037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ce536-fddc-4742-acde-eb8b7768c5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.703313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ce536-fddc-4742-acde-eb8b7768c5e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.704848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ce536-fddc-4742-acde-eb8b7768c5e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.704848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ce536-fddc-4742-acde-eb8b7768c5e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.705981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ce536-fddc-4742-acde-eb8b7768c5e2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.710381 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71390459-b697-4b99-826e-8e652ff6b683 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.721094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71390459-b697-4b99-826e-8e652ff6b683 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.721572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 327/649] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:56.725907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cfc62-b593-41fa-bae2-613665238c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.726695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cfc62-b593-41fa-bae2-613665238c7d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.727082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cfc62-b593-41fa-bae2-613665238c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.727431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cfc62-b593-41fa-bae2-613665238c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.728072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ce536-fddc-4742-acde-eb8b7768c5e2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.729054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cfc62-b593-41fa-bae2-613665238c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.729435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cfc62-b593-41fa-bae2-613665238c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.731271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cfc62-b593-41fa-bae2-613665238c7d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.740058 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ce536-fddc-4742-acde-eb8b7768c5e2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.743978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 323/650] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:56.746138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44084b15-da05-40e7-aaa8-8e6c0a71f3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.746935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084b15-da05-40e7-aaa8-8e6c0a71f3ca admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.747464 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084b15-da05-40e7-aaa8-8e6c0a71f3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.747726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44084b15-da05-40e7-aaa8-8e6c0a71f3ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.749376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cfc62-b593-41fa-bae2-613665238c7d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.755300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44084b15-da05-40e7-aaa8-8e6c0a71f3ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.757858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44084b15-da05-40e7-aaa8-8e6c0a71f3ca admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.760406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cfc62-b593-41fa-bae2-613665238c7d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.766561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d285da-258c-44a1-b42d-2ab24acd6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.767607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d285da-258c-44a1-b42d-2ab24acd6cbe admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.768065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d285da-258c-44a1-b42d-2ab24acd6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.768530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d285da-258c-44a1-b42d-2ab24acd6cbe admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.775184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-44084b15-da05-40e7-aaa8-8e6c0a71f3ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:56.776537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 328/651] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:56.777770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d895282-ec82-459c-8826-633e65ef60cd None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.778061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d895282-ec82-459c-8826-633e65ef60cd None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.778423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d895282-ec82-459c-8826-633e65ef60cd None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.780263 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d285da-258c-44a1-b42d-2ab24acd6cbe admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.782542 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d285da-258c-44a1-b42d-2ab24acd6cbe admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.783798 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 329/652] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:56.785427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d895282-ec82-459c-8826-633e65ef60cd None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.801417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c8d285da-258c-44a1-b42d-2ab24acd6cbe admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jan 27 16:36:56.803061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 324/653] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:56.804671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d895282-ec82-459c-8826-633e65ef60cd None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.804906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfb371-23de-43e4-acb5-ce067e83f156 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.805492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfb371-23de-43e4-acb5-ce067e83f156 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.805941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfb371-23de-43e4-acb5-ce067e83f156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.811190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baa632-bdca-40aa-842e-efc166741628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.811985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa632-bdca-40aa-842e-efc166741628 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.812356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa632-bdca-40aa-842e-efc166741628 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.812686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa632-bdca-40aa-842e-efc166741628 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.813566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baa632-bdca-40aa-842e-efc166741628 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.814010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baa632-bdca-40aa-842e-efc166741628 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.817165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baa632-bdca-40aa-842e-efc166741628 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.827689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-09cfb371-23de-43e4-acb5-ce067e83f156 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:56.829193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-09cfb371-23de-43e4-acb5-ce067e83f156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:56.831527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 330/654] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:56.832674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baa632-bdca-40aa-842e-efc166741628 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.838374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 325/655] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:56.839489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfb371-23de-43e4-acb5-ce067e83f156 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.852188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baa632-bdca-40aa-842e-efc166741628 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.859345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfb371-23de-43e4-acb5-ce067e83f156 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.862145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4bde7-3324-4b42-8367-33ad4a5bfcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.863417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4bde7-3324-4b42-8367-33ad4a5bfcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.864148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4bde7-3324-4b42-8367-33ad4a5bfcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.864819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4bde7-3324-4b42-8367-33ad4a5bfcc4 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.866748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4bde7-3324-4b42-8367-33ad4a5bfcc4 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:56.867065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4bde7-3324-4b42-8367-33ad4a5bfcc4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.869010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4bde7-3324-4b42-8367-33ad4a5bfcc4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.870388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9777d99-5d7a-4ef9-a421-b3c5b30556a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.872853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9777d99-5d7a-4ef9-a421-b3c5b30556a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.873381 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9777d99-5d7a-4ef9-a421-b3c5b30556a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.873883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9777d99-5d7a-4ef9-a421-b3c5b30556a8 admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/e14c278fc5654bb9ae7c05d4ba023262/roles/a22d2094a5364a8ba169d8e80f4402c5` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.888826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 331/656] 10.222.0.48 () {56 vars in 1160 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:56.889664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4bde7-3324-4b42-8367-33ad4a5bfcc4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.894096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9777d99-5d7a-4ef9-a421-b3c5b30556a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=e14c278fc5654bb9ae7c05d4ba023262, role_id=a22d2094a5364a8ba169d8e80f4402c5)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:56.898104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9777d99-5d7a-4ef9-a421-b3c5b30556a8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:56.899596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4bde7-3324-4b42-8367-33ad4a5bfcc4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.904807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8399b7-4d11-4730-a8c5-85719d0aec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:56.905628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8399b7-4d11-4730-a8c5-85719d0aec4d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:56.905905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8399b7-4d11-4730-a8c5-85719d0aec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:56.906179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8399b7-4d11-4730-a8c5-85719d0aec4d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:56.914819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 326/657] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:36:56 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/e14c278fc5654bb9ae7c05d4ba023262/roles/a22d2094a5364a8ba169d8e80f4402c5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:36:56.916255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9777d99-5d7a-4ef9-a421-b3c5b30556a8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.921482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8399b7-4d11-4730-a8c5-85719d0aec4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:56.932019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-1a8399b7-4d11-4730-a8c5-85719d0aec4d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:56.933854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 332/658] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:56.942124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8399b7-4d11-4730-a8c5-85719d0aec4d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:56.952386 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8399b7-4d11-4730-a8c5-85719d0aec4d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:56.999256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9777d99-5d7a-4ef9-a421-b3c5b30556a8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.006013 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e9a0f-3409-4897-a8a7-db67c3397db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.007097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e9a0f-3409-4897-a8a7-db67c3397db2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.007851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e9a0f-3409-4897-a8a7-db67c3397db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.008545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724e9a0f-3409-4897-a8a7-db67c3397db2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.014078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d28596-e796-4390-9447-c686bd4bd381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.015038 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d28596-e796-4390-9447-c686bd4bd381 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.015410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d28596-e796-4390-9447-c686bd4bd381 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.015814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d28596-e796-4390-9447-c686bd4bd381 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.017278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d28596-e796-4390-9447-c686bd4bd381 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:57.017278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d28596-e796-4390-9447-c686bd4bd381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.019121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d28596-e796-4390-9447-c686bd4bd381 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.019874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e9a0f-3409-4897-a8a7-db67c3397db2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.022503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724e9a0f-3409-4897-a8a7-db67c3397db2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.030081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 333/659] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:57.035062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 327/660] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:57.039100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d28596-e796-4390-9447-c686bd4bd381 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.040464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e9a0f-3409-4897-a8a7-db67c3397db2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.057546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724e9a0f-3409-4897-a8a7-db67c3397db2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.058937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d28596-e796-4390-9447-c686bd4bd381 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.066434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634d615-2edb-4c51-bfe8-0bbee965e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.067751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d615-2edb-4c51-bfe8-0bbee965e92f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.068408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d615-2edb-4c51-bfe8-0bbee965e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.068694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e634d615-2edb-4c51-bfe8-0bbee965e92f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.070456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25be0f-9468-4f1a-8731-ebb4622b18f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.071488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25be0f-9468-4f1a-8731-ebb4622b18f8 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.071794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25be0f-9468-4f1a-8731-ebb4622b18f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.072064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25be0f-9468-4f1a-8731-ebb4622b18f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.094900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25be0f-9468-4f1a-8731-ebb4622b18f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.097978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634d615-2edb-4c51-bfe8-0bbee965e92f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.099804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e634d615-2edb-4c51-bfe8-0bbee965e92f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.100269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25be0f-9468-4f1a-8731-ebb4622b18f8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.131132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-e634d615-2edb-4c51-bfe8-0bbee965e92f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:57.132399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 334/661] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:57.138198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-dc25be0f-9468-4f1a-8731-ebb4622b18f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:57.140611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 328/662] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:57.145736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634d615-2edb-4c51-bfe8-0bbee965e92f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.147031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25be0f-9468-4f1a-8731-ebb4622b18f8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.163731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e634d615-2edb-4c51-bfe8-0bbee965e92f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.166012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25be0f-9468-4f1a-8731-ebb4622b18f8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.171404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48aa98-0e9c-42be-945c-89c74524f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.171961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cfbc7-fed8-46b0-b114-c1a78507da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.172100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48aa98-0e9c-42be-945c-89c74524f78c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.172382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48aa98-0e9c-42be-945c-89c74524f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.172620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cfbc7-fed8-46b0-b114-c1a78507da42 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.172717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48aa98-0e9c-42be-945c-89c74524f78c admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.172899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cfbc7-fed8-46b0-b114-c1a78507da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.173174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cfbc7-fed8-46b0-b114-c1a78507da42 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.173395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48aa98-0e9c-42be-945c-89c74524f78c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:57.173711 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48aa98-0e9c-42be-945c-89c74524f78c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.173898 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cfbc7-fed8-46b0-b114-c1a78507da42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:57.174200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cfbc7-fed8-46b0-b114-c1a78507da42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.175306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48aa98-0e9c-42be-945c-89c74524f78c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.175788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cfbc7-fed8-46b0-b114-c1a78507da42 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.190367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 329/663] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:57.191111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 335/664] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:57.197007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cfbc7-fed8-46b0-b114-c1a78507da42 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.197155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48aa98-0e9c-42be-945c-89c74524f78c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.207783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cfbc7-fed8-46b0-b114-c1a78507da42 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.208414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48aa98-0e9c-42be-945c-89c74524f78c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.213286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e4e00-f488-4350-a5c7-ea6c13e0ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.213510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0bb69-5945-4090-ba67-494aca636bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.214073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e4e00-f488-4350-a5c7-ea6c13e0ff57 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.214280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0bb69-5945-4090-ba67-494aca636bfc admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.214380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e4e00-f488-4350-a5c7-ea6c13e0ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.214605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0bb69-5945-4090-ba67-494aca636bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.214720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e4e00-f488-4350-a5c7-ea6c13e0ff57 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.214884 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0bb69-5945-4090-ba67-494aca636bfc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.223275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0bb69-5945-4090-ba67-494aca636bfc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.224265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e4e00-f488-4350-a5c7-ea6c13e0ff57 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.225312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0bb69-5945-4090-ba67-494aca636bfc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.226475 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e4e00-f488-4350-a5c7-ea6c13e0ff57 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.240481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-2ce0bb69-5945-4090-ba67-494aca636bfc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:57.242308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-475e4e00-f488-4350-a5c7-ea6c13e0ff57 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jan 27 16:36:57.243380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 336/665] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:57.243558 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 330/666] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:57.249066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0bb69-5945-4090-ba67-494aca636bfc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.249509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e4e00-f488-4350-a5c7-ea6c13e0ff57 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.259676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0bb69-5945-4090-ba67-494aca636bfc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.259969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e4e00-f488-4350-a5c7-ea6c13e0ff57 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.264899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad49b1-23b1-4cb4-ba48-f0851b07440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.265618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779ebd9-a6ee-4da1-86be-1f426bc3047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.265808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad49b1-23b1-4cb4-ba48-f0851b07440f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.265958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad49b1-23b1-4cb4-ba48-f0851b07440f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.266205 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad49b1-23b1-4cb4-ba48-f0851b07440f admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.266377 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ebd9-a6ee-4da1-86be-1f426bc3047d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.266529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ebd9-a6ee-4da1-86be-1f426bc3047d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.266802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779ebd9-a6ee-4da1-86be-1f426bc3047d admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.267047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad49b1-23b1-4cb4-ba48-f0851b07440f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:57.267363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad49b1-23b1-4cb4-ba48-f0851b07440f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.267677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779ebd9-a6ee-4da1-86be-1f426bc3047d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:57.267994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779ebd9-a6ee-4da1-86be-1f426bc3047d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.269366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad49b1-23b1-4cb4-ba48-f0851b07440f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.269891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779ebd9-a6ee-4da1-86be-1f426bc3047d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.283697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 337/667] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:57.291295 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 331/668] 10.222.0.48 () {56 vars in 1158 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:36:57.296735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad49b1-23b1-4cb4-ba48-f0851b07440f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.297473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779ebd9-a6ee-4da1-86be-1f426bc3047d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.307525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779ebd9-a6ee-4da1-86be-1f426bc3047d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.313451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3037d-0f55-4920-97e7-635ada8c3709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.314096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3037d-0f55-4920-97e7-635ada8c3709 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.314384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3037d-0f55-4920-97e7-635ada8c3709 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.314612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad49b1-23b1-4cb4-ba48-f0851b07440f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.314798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3037d-0f55-4920-97e7-635ada8c3709 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.323146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a1e4-e60a-4bd7-a649-ec39bd16504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.323604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3037d-0f55-4920-97e7-635ada8c3709 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.323883 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a1e4-e60a-4bd7-a649-ec39bd16504d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.324156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a1e4-e60a-4bd7-a649-ec39bd16504d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.324445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d5a1e4-e60a-4bd7-a649-ec39bd16504d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.325412 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5a1e4-e60a-4bd7-a649-ec39bd16504d admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=15ae418635734639a4d10676978e82cf) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:57.326072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3037d-0f55-4920-97e7-635ada8c3709 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.326396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5a1e4-e60a-4bd7-a649-ec39bd16504d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.328481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d5a1e4-e60a-4bd7-a649-ec39bd16504d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.339957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 332/669] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:57.343663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3037d-0f55-4920-97e7-635ada8c3709 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.347668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 338/670] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/role_assignments?user.id=15ae418635734639a4d10676978e82cf&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:57.354037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3037d-0f55-4920-97e7-635ada8c3709 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.359539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c0040-4f93-4b25-92b6-2d098b02f970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.360390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c0040-4f93-4b25-92b6-2d098b02f970 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.360677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c0040-4f93-4b25-92b6-2d098b02f970 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.360955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c0040-4f93-4b25-92b6-2d098b02f970 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.372275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c0040-4f93-4b25-92b6-2d098b02f970 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.374170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c0040-4f93-4b25-92b6-2d098b02f970 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.392868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-612c0040-4f93-4b25-92b6-2d098b02f970 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:57.398855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 333/671] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:57.400413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a1e4-e60a-4bd7-a649-ec39bd16504d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.411236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d5a1e4-e60a-4bd7-a649-ec39bd16504d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.416017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcb4dc-f6e2-43e1-b655-5e9982de630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.416753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcb4dc-f6e2-43e1-b655-5e9982de630e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.417037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcb4dc-f6e2-43e1-b655-5e9982de630e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.417316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bcb4dc-f6e2-43e1-b655-5e9982de630e admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.418127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcb4dc-f6e2-43e1-b655-5e9982de630e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:57.418438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcb4dc-f6e2-43e1-b655-5e9982de630e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.420884 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bcb4dc-f6e2-43e1-b655-5e9982de630e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.439752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 339/672] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:57.441929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c0040-4f93-4b25-92b6-2d098b02f970 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.453472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c0040-4f93-4b25-92b6-2d098b02f970 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.458519 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d757df-b0ea-43f7-a1cf-b5ea662d4bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.459385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d757df-b0ea-43f7-a1cf-b5ea662d4bbb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.459707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d757df-b0ea-43f7-a1cf-b5ea662d4bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.459992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d757df-b0ea-43f7-a1cf-b5ea662d4bbb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.469678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d757df-b0ea-43f7-a1cf-b5ea662d4bbb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.471759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d757df-b0ea-43f7-a1cf-b5ea662d4bbb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.486595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-e8d757df-b0ea-43f7-a1cf-b5ea662d4bbb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:57.488094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 334/673] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:57.494775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcb4dc-f6e2-43e1-b655-5e9982de630e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.507606 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bcb4dc-f6e2-43e1-b655-5e9982de630e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.512692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf6987-16cc-4a73-a087-3d70e3892264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.514122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf6987-16cc-4a73-a087-3d70e3892264 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.514412 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf6987-16cc-4a73-a087-3d70e3892264 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.514747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf6987-16cc-4a73-a087-3d70e3892264 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.515588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf6987-16cc-4a73-a087-3d70e3892264 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:57.515988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf6987-16cc-4a73-a087-3d70e3892264 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.517978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf6987-16cc-4a73-a087-3d70e3892264 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.535740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 340/674] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:57.538522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d757df-b0ea-43f7-a1cf-b5ea662d4bbb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:57.550455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d757df-b0ea-43f7-a1cf-b5ea662d4bbb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:57.555709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4214576-a30b-4020-8030-3471cc3e287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:57.556361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4214576-a30b-4020-8030-3471cc3e287f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:57.556647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4214576-a30b-4020-8030-3471cc3e287f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:57.556932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4214576-a30b-4020-8030-3471cc3e287f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:57.557761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4214576-a30b-4020-8030-3471cc3e287f admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=295fe8f61f87423bb49471e2f0085690) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:57.558076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4214576-a30b-4020-8030-3471cc3e287f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:57.560782 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4214576-a30b-4020-8030-3471cc3e287f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:57.570612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 335/675] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:57 2022] GET /identity/v3/role_assignments?user.id=295fe8f61f87423bb49471e2f0085690&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:58.637347 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905168f0-18b4-4069-a414-3e568c582f54 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:58.638142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905168f0-18b4-4069-a414-3e568c582f54 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:58.638142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905168f0-18b4-4069-a414-3e568c582f54 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:58.640146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 341/676] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:58.645141 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736522b-52de-49d1-a4f0-8a10590f96a6 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:58.645652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736522b-52de-49d1-a4f0-8a10590f96a6 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:58.645812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736522b-52de-49d1-a4f0-8a10590f96a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:58.669623 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c736522b-52de-49d1-a4f0-8a10590f96a6 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:58.670808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c736522b-52de-49d1-a4f0-8a10590f96a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:58.680251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 336/677] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:36:58.705927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905168f0-18b4-4069-a414-3e568c582f54 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:58.722762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905168f0-18b4-4069-a414-3e568c582f54 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:58.727398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0117fc0-c376-4b1d-af18-05dcec4d1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:58.729378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0117fc0-c376-4b1d-af18-05dcec4d1c2a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:58.729378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0117fc0-c376-4b1d-af18-05dcec4d1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:58.729378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0117fc0-c376-4b1d-af18-05dcec4d1c2a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:58.739865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0117fc0-c376-4b1d-af18-05dcec4d1c2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:58.751434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-a0117fc0-c376-4b1d-af18-05dcec4d1c2a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:36:58.752701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 342/678] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:58.758526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736522b-52de-49d1-a4f0-8a10590f96a6 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:58.768524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736522b-52de-49d1-a4f0-8a10590f96a6 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:58.775772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8786-43ed-421b-bdf2-96cf779a7cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:58.776437 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8786-43ed-421b-bdf2-96cf779a7cfa admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:58.776722 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8786-43ed-421b-bdf2-96cf779a7cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:58.777002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa8786-43ed-421b-bdf2-96cf779a7cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:58.777764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa8786-43ed-421b-bdf2-96cf779a7cfa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:58.778069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa8786-43ed-421b-bdf2-96cf779a7cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:58.779752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa8786-43ed-421b-bdf2-96cf779a7cfa admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:58.793037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 337/679] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:58.794303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0117fc0-c376-4b1d-af18-05dcec4d1c2a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:58.805854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0117fc0-c376-4b1d-af18-05dcec4d1c2a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:58.819264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c20a83-4559-42be-bf53-0aad61558fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:58.820091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c20a83-4559-42be-bf53-0aad61558fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:58.820366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c20a83-4559-42be-bf53-0aad61558fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:58.820635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c20a83-4559-42be-bf53-0aad61558fc5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:58.839348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c20a83-4559-42be-bf53-0aad61558fc5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:58.841430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c20a83-4559-42be-bf53-0aad61558fc5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:58.865462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-f4c20a83-4559-42be-bf53-0aad61558fc5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:58.866713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 343/680] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:58.872850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8786-43ed-421b-bdf2-96cf779a7cfa admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:58.889709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa8786-43ed-421b-bdf2-96cf779a7cfa admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:58.899064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885acbb1-d5da-4db9-87ae-d9e8500ee5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:58.899814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885acbb1-d5da-4db9-87ae-d9e8500ee5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:58.900101 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885acbb1-d5da-4db9-87ae-d9e8500ee5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:58.900380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885acbb1-d5da-4db9-87ae-d9e8500ee5c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:58.901234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885acbb1-d5da-4db9-87ae-d9e8500ee5c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:58.901579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885acbb1-d5da-4db9-87ae-d9e8500ee5c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:58.903269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885acbb1-d5da-4db9-87ae-d9e8500ee5c5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:58.923326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 338/681] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:58.927764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c20a83-4559-42be-bf53-0aad61558fc5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:58.949149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c20a83-4559-42be-bf53-0aad61558fc5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:58.965223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbcb3d-02ea-4b2f-b117-a35f27dba881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:58.966061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbcb3d-02ea-4b2f-b117-a35f27dba881 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:58.966442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbcb3d-02ea-4b2f-b117-a35f27dba881 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:58.966938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dbcb3d-02ea-4b2f-b117-a35f27dba881 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:58.976600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbcb3d-02ea-4b2f-b117-a35f27dba881 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:58.978691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dbcb3d-02ea-4b2f-b117-a35f27dba881 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:58.993720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-87dbcb3d-02ea-4b2f-b117-a35f27dba881 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 27 16:36:58.995326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 344/682] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jan 27 16:36:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:59.001130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885acbb1-d5da-4db9-87ae-d9e8500ee5c5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.011512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885acbb1-d5da-4db9-87ae-d9e8500ee5c5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.022700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a11edf-6436-47dc-9d5e-76899a764de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.023424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a11edf-6436-47dc-9d5e-76899a764de0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.023770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a11edf-6436-47dc-9d5e-76899a764de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.024095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a11edf-6436-47dc-9d5e-76899a764de0 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.024952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a11edf-6436-47dc-9d5e-76899a764de0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:59.025322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a11edf-6436-47dc-9d5e-76899a764de0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.027332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a11edf-6436-47dc-9d5e-76899a764de0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.051455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 339/683] 10.222.0.48 () {56 vars in 1154 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:59.056900 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbcb3d-02ea-4b2f-b117-a35f27dba881 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.067151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dbcb3d-02ea-4b2f-b117-a35f27dba881 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.074674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39660236-825a-4a9b-b061-fb5c2f941783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.075884 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39660236-825a-4a9b-b061-fb5c2f941783 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.076263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39660236-825a-4a9b-b061-fb5c2f941783 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.076551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39660236-825a-4a9b-b061-fb5c2f941783 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.085486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39660236-825a-4a9b-b061-fb5c2f941783 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.087310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39660236-825a-4a9b-b061-fb5c2f941783 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.097729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 345/684] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:59.102982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a11edf-6436-47dc-9d5e-76899a764de0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.114396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a11edf-6436-47dc-9d5e-76899a764de0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.127751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a634399-905a-418d-bec0-3de2a131997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.128649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a634399-905a-418d-bec0-3de2a131997d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.128935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a634399-905a-418d-bec0-3de2a131997d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.129218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a634399-905a-418d-bec0-3de2a131997d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.142349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a634399-905a-418d-bec0-3de2a131997d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.144342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a634399-905a-418d-bec0-3de2a131997d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.175592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-2a634399-905a-418d-bec0-3de2a131997d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:59.176859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 340/685] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:59.182396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39660236-825a-4a9b-b061-fb5c2f941783 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.192006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39660236-825a-4a9b-b061-fb5c2f941783 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.199759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc93ae4-7dc0-4ecb-b072-ee14c78da085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.201050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc93ae4-7dc0-4ecb-b072-ee14c78da085 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.201434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc93ae4-7dc0-4ecb-b072-ee14c78da085 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.201717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc93ae4-7dc0-4ecb-b072-ee14c78da085 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.202516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc93ae4-7dc0-4ecb-b072-ee14c78da085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:59.202830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc93ae4-7dc0-4ecb-b072-ee14c78da085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.204512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc93ae4-7dc0-4ecb-b072-ee14c78da085 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.217314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 346/686] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:59.222288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a634399-905a-418d-bec0-3de2a131997d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.237492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a634399-905a-418d-bec0-3de2a131997d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.247057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93479cc-5d13-4619-9635-a8202b311a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.248111 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93479cc-5d13-4619-9635-a8202b311a64 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.248371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93479cc-5d13-4619-9635-a8202b311a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.248706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93479cc-5d13-4619-9635-a8202b311a64 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.257102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93479cc-5d13-4619-9635-a8202b311a64 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.259160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93479cc-5d13-4619-9635-a8202b311a64 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.278064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-a93479cc-5d13-4619-9635-a8202b311a64 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:36:59.284441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 341/687] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:59.285492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc93ae4-7dc0-4ecb-b072-ee14c78da085 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.296048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc93ae4-7dc0-4ecb-b072-ee14c78da085 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.303889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236218a8-06ab-46d1-be0f-724dfa19eefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.304601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236218a8-06ab-46d1-be0f-724dfa19eefd admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.304887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236218a8-06ab-46d1-be0f-724dfa19eefd admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.305224 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236218a8-06ab-46d1-be0f-724dfa19eefd admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.306030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236218a8-06ab-46d1-be0f-724dfa19eefd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:59.306399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236218a8-06ab-46d1-be0f-724dfa19eefd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.308458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236218a8-06ab-46d1-be0f-724dfa19eefd admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.327674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 347/688] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:59.333751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93479cc-5d13-4619-9635-a8202b311a64 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.345937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93479cc-5d13-4619-9635-a8202b311a64 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.354299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc479ff-b1a2-4231-9639-52737dafd436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.355015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc479ff-b1a2-4231-9639-52737dafd436 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.359963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc479ff-b1a2-4231-9639-52737dafd436 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.360278 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc479ff-b1a2-4231-9639-52737dafd436 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.361215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc479ff-b1a2-4231-9639-52737dafd436 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=8500a8d242bf43a9b2fd538c3b1bb037) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:59.361537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc479ff-b1a2-4231-9639-52737dafd436 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.363504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc479ff-b1a2-4231-9639-52737dafd436 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.370368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 342/689] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/role_assignments?user.id=8500a8d242bf43a9b2fd538c3b1bb037&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:59.497888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278608d6-b49a-439b-8225-810b621ec75a None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.498237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278608d6-b49a-439b-8225-810b621ec75a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.498445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278608d6-b49a-439b-8225-810b621ec75a None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.500647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 348/690] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:59.506774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ac3d-840e-4f5d-ac5b-b489c223cbfb None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.507080 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284bd46-a24e-4fa3-be4d-225fb17f160b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.507238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ac3d-840e-4f5d-ac5b-b489c223cbfb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.507385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284bd46-a24e-4fa3-be4d-225fb17f160b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.507525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70ac3d-840e-4f5d-ac5b-b489c223cbfb None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.507694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284bd46-a24e-4fa3-be4d-225fb17f160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.509695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 343/691] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:36:59.515096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1626-03fe-4a40-ad37-9e6d5d8476e5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.515336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1626-03fe-4a40-ad37-9e6d5d8476e5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.516299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b1626-03fe-4a40-ad37-9e6d5d8476e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.527951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-a284bd46-a24e-4fa3-be4d-225fb17f160b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:59.529456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a284bd46-a24e-4fa3-be4d-225fb17f160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:59.539449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 349/692] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:59.561523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-991b1626-03fe-4a40-ad37-9e6d5d8476e5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:36:59.562670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-991b1626-03fe-4a40-ad37-9e6d5d8476e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:36:59.565939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284bd46-a24e-4fa3-be4d-225fb17f160b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.576354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284bd46-a24e-4fa3-be4d-225fb17f160b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.578048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 344/693] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:36:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:36:59.589666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd360b75-91cd-4e18-9d4f-7e43d30b472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.590489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd360b75-91cd-4e18-9d4f-7e43d30b472d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.590765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd360b75-91cd-4e18-9d4f-7e43d30b472d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.591602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd360b75-91cd-4e18-9d4f-7e43d30b472d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.602707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1626-03fe-4a40-ad37-9e6d5d8476e5 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.617882 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd360b75-91cd-4e18-9d4f-7e43d30b472d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:36:59.622125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b1626-03fe-4a40-ad37-9e6d5d8476e5 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.626123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-bd360b75-91cd-4e18-9d4f-7e43d30b472d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:36:59.628425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 350/694] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:59.634947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd360b75-91cd-4e18-9d4f-7e43d30b472d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.641585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.642423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.642709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.642988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.643690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.644728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:59.644728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:59.644728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:59.645620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.647173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd360b75-91cd-4e18-9d4f-7e43d30b472d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.653114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9030f-af2c-44da-8364-9110c2479836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.654437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9030f-af2c-44da-8364-9110c2479836 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.654788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9030f-af2c-44da-8364-9110c2479836 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.655132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9030f-af2c-44da-8364-9110c2479836 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.656021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9030f-af2c-44da-8364-9110c2479836 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:59.656398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9030f-af2c-44da-8364-9110c2479836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.658045 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f9030f-af2c-44da-8364-9110c2479836 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.668349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 351/695] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:59.668846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 27 16:36:59.671422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 345/696] 10.222.0.48 () {56 vars in 1150 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:59.674010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9030f-af2c-44da-8364-9110c2479836 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.678527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.689147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588aed5-ed30-4ce1-ab1b-d65809596fc3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.689936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9030f-af2c-44da-8364-9110c2479836 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.694742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.695391 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.695762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.696046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.696881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:59.697193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.697502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89e7b2-4b0a-4cff-afa9-db3ed7955cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.698398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:36:59.698398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:36:59.698398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:36:59.698834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89e7b2-4b0a-4cff-afa9-db3ed7955cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.699317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89e7b2-4b0a-4cff-afa9-db3ed7955cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.699416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.699891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89e7b2-4b0a-4cff-afa9-db3ed7955cf0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.705934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 346/697] 10.222.0.48 () {56 vars in 1145 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:59.712419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89e7b2-4b0a-4cff-afa9-db3ed7955cf0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.714521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89e7b2-4b0a-4cff-afa9-db3ed7955cf0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.717184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.732799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6aec1-66af-4c9a-a654-2bbd6846bbcb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.741491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-4f89e7b2-4b0a-4cff-afa9-db3ed7955cf0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:36:59.743653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 352/698] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:36:59.744295 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58d3d6-9e45-43c6-8da1-5e99cec3dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.745011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58d3d6-9e45-43c6-8da1-5e99cec3dea9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.745298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58d3d6-9e45-43c6-8da1-5e99cec3dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.745579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58d3d6-9e45-43c6-8da1-5e99cec3dea9 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.746304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58d3d6-9e45-43c6-8da1-5e99cec3dea9 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:59.746657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58d3d6-9e45-43c6-8da1-5e99cec3dea9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.748575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58d3d6-9e45-43c6-8da1-5e99cec3dea9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.750848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89e7b2-4b0a-4cff-afa9-db3ed7955cf0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.761353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 347/699] 10.222.0.48 () {56 vars in 1145 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:59.765652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89e7b2-4b0a-4cff-afa9-db3ed7955cf0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.770938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a05f6-b4a5-46d5-b45b-8c9f1f8a7af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.771720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a05f6-b4a5-46d5-b45b-8c9f1f8a7af2 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.772012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a05f6-b4a5-46d5-b45b-8c9f1f8a7af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.772293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a05f6-b4a5-46d5-b45b-8c9f1f8a7af2 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.773150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a05f6-b4a5-46d5-b45b-8c9f1f8a7af2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:59.773463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a05f6-b4a5-46d5-b45b-8c9f1f8a7af2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.775138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a05f6-b4a5-46d5-b45b-8c9f1f8a7af2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.789409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 353/700] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:59.795862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58d3d6-9e45-43c6-8da1-5e99cec3dea9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.806171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58d3d6-9e45-43c6-8da1-5e99cec3dea9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.811836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3084e-00fa-4e4c-a54b-1b18b5dfbd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.812647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3084e-00fa-4e4c-a54b-1b18b5dfbd64 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.812937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3084e-00fa-4e4c-a54b-1b18b5dfbd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.813220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3084e-00fa-4e4c-a54b-1b18b5dfbd64 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.829779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3084e-00fa-4e4c-a54b-1b18b5dfbd64 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.832919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3084e-00fa-4e4c-a54b-1b18b5dfbd64 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.854367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-86c3084e-00fa-4e4c-a54b-1b18b5dfbd64 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 27 16:36:59.856026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 348/701] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:36:59.862547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a05f6-b4a5-46d5-b45b-8c9f1f8a7af2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.877483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a05f6-b4a5-46d5-b45b-8c9f1f8a7af2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.883310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82000da7-61a0-4c34-b65e-813b37316af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.884091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82000da7-61a0-4c34-b65e-813b37316af5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.884375 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82000da7-61a0-4c34-b65e-813b37316af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.884747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82000da7-61a0-4c34-b65e-813b37316af5 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.885736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82000da7-61a0-4c34-b65e-813b37316af5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:36:59.886104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82000da7-61a0-4c34-b65e-813b37316af5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.888670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82000da7-61a0-4c34-b65e-813b37316af5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.915482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 354/702] 10.222.0.48 () {56 vars in 1156 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:36:59.921823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3084e-00fa-4e4c-a54b-1b18b5dfbd64 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.937501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3084e-00fa-4e4c-a54b-1b18b5dfbd64 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.943361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826b94c-fac9-4f5a-b872-d929d72dd31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.944227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b94c-fac9-4f5a-b872-d929d72dd31d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.944579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b94c-fac9-4f5a-b872-d929d72dd31d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.944859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b94c-fac9-4f5a-b872-d929d72dd31d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:36:59.959675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826b94c-fac9-4f5a-b872-d929d72dd31d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:36:59.961556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826b94c-fac9-4f5a-b872-d929d72dd31d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:36:59.973388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 349/703] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:36:59.979418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82000da7-61a0-4c34-b65e-813b37316af5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:36:59.992667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82000da7-61a0-4c34-b65e-813b37316af5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:36:59.998197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82cf1-5059-46dd-ad6c-20a6d74124e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:36:59.998990 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82cf1-5059-46dd-ad6c-20a6d74124e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:36:59.999326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82cf1-5059-46dd-ad6c-20a6d74124e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:36:59.999677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c82cf1-5059-46dd-ad6c-20a6d74124e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.014962 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c82cf1-5059-46dd-ad6c-20a6d74124e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.016872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c82cf1-5059-46dd-ad6c-20a6d74124e8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.036078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-92c82cf1-5059-46dd-ad6c-20a6d74124e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:00.037637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 355/704] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:00.042871 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826b94c-fac9-4f5a-b872-d929d72dd31d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.052511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826b94c-fac9-4f5a-b872-d929d72dd31d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:00.057474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981778-6df8-4051-ba87-b7422ab8705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:00.058185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981778-6df8-4051-ba87-b7422ab8705b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.058471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981778-6df8-4051-ba87-b7422ab8705b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.058754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981778-6df8-4051-ba87-b7422ab8705b admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.059544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a981778-6df8-4051-ba87-b7422ab8705b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:00.060414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a981778-6df8-4051-ba87-b7422ab8705b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.062243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a981778-6df8-4051-ba87-b7422ab8705b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.075443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 350/705] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:00.084671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82cf1-5059-46dd-ad6c-20a6d74124e8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.096694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c82cf1-5059-46dd-ad6c-20a6d74124e8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:00.103977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b725b-8810-4356-a3ae-2ddb1d17b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:00.104822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b725b-8810-4356-a3ae-2ddb1d17b0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.105113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b725b-8810-4356-a3ae-2ddb1d17b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.105444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b725b-8810-4356-a3ae-2ddb1d17b0d4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.115436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b725b-8810-4356-a3ae-2ddb1d17b0d4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.117458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b725b-8810-4356-a3ae-2ddb1d17b0d4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.133946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-866b725b-8810-4356-a3ae-2ddb1d17b0d4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:00.135549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 356/706] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:00.141690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981778-6df8-4051-ba87-b7422ab8705b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.152337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981778-6df8-4051-ba87-b7422ab8705b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:00.159260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbbff4-7f42-440c-aa49-8f7ea8d99f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:00.160009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbbff4-7f42-440c-aa49-8f7ea8d99f4e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.160297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbbff4-7f42-440c-aa49-8f7ea8d99f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.160579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbbff4-7f42-440c-aa49-8f7ea8d99f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.161449 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbbff4-7f42-440c-aa49-8f7ea8d99f4e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:00.161758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbbff4-7f42-440c-aa49-8f7ea8d99f4e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.163698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbbff4-7f42-440c-aa49-8f7ea8d99f4e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.183194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 351/707] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:00.189574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b725b-8810-4356-a3ae-2ddb1d17b0d4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.202871 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b725b-8810-4356-a3ae-2ddb1d17b0d4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:00.208325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc294d8-9c2f-4731-a6fc-00d4cb16b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:00.208980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc294d8-9c2f-4731-a6fc-00d4cb16b0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.209315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc294d8-9c2f-4731-a6fc-00d4cb16b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.209598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc294d8-9c2f-4731-a6fc-00d4cb16b0e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.210498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc294d8-9c2f-4731-a6fc-00d4cb16b0e8 admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=e14c278fc5654bb9ae7c05d4ba023262) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:00.210816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc294d8-9c2f-4731-a6fc-00d4cb16b0e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.212742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc294d8-9c2f-4731-a6fc-00d4cb16b0e8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.224684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 357/708] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:00 2022] GET /identity/v3/role_assignments?user.id=e14c278fc5654bb9ae7c05d4ba023262&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:00.602843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccf1c2-5ddd-4f1e-b889-f7b26ecc6d66 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.603154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccf1c2-5ddd-4f1e-b889-f7b26ecc6d66 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.603403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccf1c2-5ddd-4f1e-b889-f7b26ecc6d66 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.605643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 352/709] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:00.611363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc3b2-99b0-4c79-ae8c-9745b1ba8b38 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.611669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc3b2-99b0-4c79-ae8c-9745b1ba8b38 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.611964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fc3b2-99b0-4c79-ae8c-9745b1ba8b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.630961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d46fc3b2-99b0-4c79-ae8c-9745b1ba8b38 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:00.632196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d46fc3b2-99b0-4c79-ae8c-9745b1ba8b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:00.641083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 358/710] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jan 27 16:37:00.664534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccf1c2-5ddd-4f1e-b889-f7b26ecc6d66 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.677726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccf1c2-5ddd-4f1e-b889-f7b26ecc6d66 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:00.683259 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d099a-9ac8-4b73-98a3-079d248b998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:00.684143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d099a-9ac8-4b73-98a3-079d248b998f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.684436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d099a-9ac8-4b73-98a3-079d248b998f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.684718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729d099a-9ac8-4b73-98a3-079d248b998f admin admin] PATH_INFO: `/v3/services/network` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.687143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d099a-9ac8-4b73-98a3-079d248b998f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.687143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729d099a-9ac8-4b73-98a3-079d248b998f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.705634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-729d099a-9ac8-4b73-98a3-079d248b998f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 27 16:37:00.707170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 353/711] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:00 2022] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:00.712957 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc3b2-99b0-4c79-ae8c-9745b1ba8b38 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.723512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fc3b2-99b0-4c79-ae8c-9745b1ba8b38 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:00.728199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a719a408-958d-4953-8652-5ea5cf2806ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:00.728897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a408-958d-4953-8652-5ea5cf2806ed admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.729195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a408-958d-4953-8652-5ea5cf2806ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.729511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a719a408-958d-4953-8652-5ea5cf2806ed admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.730186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719a408-958d-4953-8652-5ea5cf2806ed admin admin] RBAC: Adding query filter params (name=network) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:00.730495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719a408-958d-4953-8652-5ea5cf2806ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.731530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-a719a408-958d-4953-8652-5ea5cf2806ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:00.731530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:37:00.731530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:37:00.732514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a719a408-958d-4953-8652-5ea5cf2806ed admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.737763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 359/712] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:00.743285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d099a-9ac8-4b73-98a3-079d248b998f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.753428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729d099a-9ac8-4b73-98a3-079d248b998f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:00.758151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32e3f-1635-456e-becf-411ad04ac626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:00.758786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32e3f-1635-456e-becf-411ad04ac626 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.759118 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32e3f-1635-456e-becf-411ad04ac626 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.759403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32e3f-1635-456e-becf-411ad04ac626 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.760324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32e3f-1635-456e-becf-411ad04ac626 admin admin] RBAC: Adding query filter params (type=network) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:00.760635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32e3f-1635-456e-becf-411ad04ac626 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.762294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32e3f-1635-456e-becf-411ad04ac626 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.765803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbb295-01a7-4dc5-b561-c5c12b3ad03f None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.766266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbb295-01a7-4dc5-b561-c5c12b3ad03f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.766629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbb295-01a7-4dc5-b561-c5c12b3ad03f None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.769126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 360/713] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:00.770382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 354/714] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:00.774580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b808a68-1699-4847-93bc-0624204b935b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.774879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b808a68-1699-4847-93bc-0624204b935b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.775163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b808a68-1699-4847-93bc-0624204b935b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.797691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7b808a68-1699-4847-93bc-0624204b935b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:00.798839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7b808a68-1699-4847-93bc-0624204b935b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:00.807248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 361/715] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:37:00.836634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32e3f-1635-456e-becf-411ad04ac626 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.849962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32e3f-1635-456e-becf-411ad04ac626 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:00.863051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa2939-003d-4c3e-9a93-26b0f68b7927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:00.863894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa2939-003d-4c3e-9a93-26b0f68b7927 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.864186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa2939-003d-4c3e-9a93-26b0f68b7927 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.864468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa2939-003d-4c3e-9a93-26b0f68b7927 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.879319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa2939-003d-4c3e-9a93-26b0f68b7927 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.881231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa2939-003d-4c3e-9a93-26b0f68b7927 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.913908 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-6faa2939-003d-4c3e-9a93-26b0f68b7927 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:00.915557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 355/716] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:00.921889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b808a68-1699-4847-93bc-0624204b935b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.937927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b808a68-1699-4847-93bc-0624204b935b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:00.956289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc2d4f-b98b-4267-803b-83ec6507171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:00.957442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc2d4f-b98b-4267-803b-83ec6507171d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:00.958142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc2d4f-b98b-4267-803b-83ec6507171d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:00.958830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc2d4f-b98b-4267-803b-83ec6507171d admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:00.960473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc2d4f-b98b-4267-803b-83ec6507171d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:00.961264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc2d4f-b98b-4267-803b-83ec6507171d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:00.964590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc2d4f-b98b-4267-803b-83ec6507171d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:00.980839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 362/717] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:00.986208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa2939-003d-4c3e-9a93-26b0f68b7927 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:00.998552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa2939-003d-4c3e-9a93-26b0f68b7927 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:01.003095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f23bc-2bf2-4146-9871-e243e679aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:01.003792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f23bc-2bf2-4146-9871-e243e679aacd admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:01.004082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f23bc-2bf2-4146-9871-e243e679aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:01.004360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f23bc-2bf2-4146-9871-e243e679aacd admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:01.005097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f23bc-2bf2-4146-9871-e243e679aacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:01.007008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f23bc-2bf2-4146-9871-e243e679aacd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:01.030654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 356/718] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:37:00 2022] POST /identity/v3/users => generated 254 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:02.112011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520873c-ec66-4a8f-b72f-2b2b7077afbb None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.112554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520873c-ec66-4a8f-b72f-2b2b7077afbb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.112554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520873c-ec66-4a8f-b72f-2b2b7077afbb None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.114561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 363/719] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:02.119821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea773f-0a72-4570-a718-37a23fb11c81 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.120219 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea773f-0a72-4570-a718-37a23fb11c81 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.120382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea773f-0a72-4570-a718-37a23fb11c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.139140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-43ea773f-0a72-4570-a718-37a23fb11c81 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:02.140358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-43ea773f-0a72-4570-a718-37a23fb11c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:02.148380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 357/720] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:37:02.179178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520873c-ec66-4a8f-b72f-2b2b7077afbb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.197266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520873c-ec66-4a8f-b72f-2b2b7077afbb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.206589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47a393-9fe2-4156-8aab-0f1a45d70ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.207799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47a393-9fe2-4156-8aab-0f1a45d70ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.208305 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47a393-9fe2-4156-8aab-0f1a45d70ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.208788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47a393-9fe2-4156-8aab-0f1a45d70ec7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.228762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47a393-9fe2-4156-8aab-0f1a45d70ec7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:02.236950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-8d47a393-9fe2-4156-8aab-0f1a45d70ec7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:02.238625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 364/721] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:02.244285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea773f-0a72-4570-a718-37a23fb11c81 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.261964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea773f-0a72-4570-a718-37a23fb11c81 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.271508 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07338c5-6bf6-47f2-9ec0-5fa08c038eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.272206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07338c5-6bf6-47f2-9ec0-5fa08c038eea admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.272492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07338c5-6bf6-47f2-9ec0-5fa08c038eea admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.272772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07338c5-6bf6-47f2-9ec0-5fa08c038eea admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.273532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07338c5-6bf6-47f2-9ec0-5fa08c038eea admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:02.273837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07338c5-6bf6-47f2-9ec0-5fa08c038eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.275427 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07338c5-6bf6-47f2-9ec0-5fa08c038eea admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.293726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 358/722] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:02.299141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47a393-9fe2-4156-8aab-0f1a45d70ec7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.312427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47a393-9fe2-4156-8aab-0f1a45d70ec7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.319471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908579f-6fbd-44ab-ba0b-f51d236360bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.320339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908579f-6fbd-44ab-ba0b-f51d236360bc admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.320621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908579f-6fbd-44ab-ba0b-f51d236360bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.320899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908579f-6fbd-44ab-ba0b-f51d236360bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.334587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908579f-6fbd-44ab-ba0b-f51d236360bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.336648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908579f-6fbd-44ab-ba0b-f51d236360bc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.358872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-4908579f-6fbd-44ab-ba0b-f51d236360bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:02.360444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 365/723] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:02.365692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07338c5-6bf6-47f2-9ec0-5fa08c038eea admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.384823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07338c5-6bf6-47f2-9ec0-5fa08c038eea admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.400255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aede7-551c-4cc1-80c7-b56152862483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.401293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aede7-551c-4cc1-80c7-b56152862483 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.401802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aede7-551c-4cc1-80c7-b56152862483 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.402269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aede7-551c-4cc1-80c7-b56152862483 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.403193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aede7-551c-4cc1-80c7-b56152862483 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:02.403769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aede7-551c-4cc1-80c7-b56152862483 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.405865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22aede7-551c-4cc1-80c7-b56152862483 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.421140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 359/724] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:02.426517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908579f-6fbd-44ab-ba0b-f51d236360bc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.440835 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908579f-6fbd-44ab-ba0b-f51d236360bc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.448140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd057b2-3c3f-4f87-a673-36036291eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.448991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd057b2-3c3f-4f87-a673-36036291eec6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.449279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd057b2-3c3f-4f87-a673-36036291eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.449565 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd057b2-3c3f-4f87-a673-36036291eec6 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.461945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd057b2-3c3f-4f87-a673-36036291eec6 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.464216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd057b2-3c3f-4f87-a673-36036291eec6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.486080 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-4fd057b2-3c3f-4f87-a673-36036291eec6 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 27 16:37:02.487456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 366/725] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:02.492940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aede7-551c-4cc1-80c7-b56152862483 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.517957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aede7-551c-4cc1-80c7-b56152862483 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.523012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723376fe-14a5-4a7a-9e0e-ac7421787fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.523927 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723376fe-14a5-4a7a-9e0e-ac7421787fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.524428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723376fe-14a5-4a7a-9e0e-ac7421787fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.524895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723376fe-14a5-4a7a-9e0e-ac7421787fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.525937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723376fe-14a5-4a7a-9e0e-ac7421787fa1 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:02.526435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723376fe-14a5-4a7a-9e0e-ac7421787fa1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.528495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723376fe-14a5-4a7a-9e0e-ac7421787fa1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.534431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e30bd-1601-443e-9efb-2efd91a410e2 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.534729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e30bd-1601-443e-9efb-2efd91a410e2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.535013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e30bd-1601-443e-9efb-2efd91a410e2 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.537398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 367/726] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:02.542732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af7fd-73f2-415a-8e55-d025aa2340cd None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.543027 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af7fd-73f2-415a-8e55-d025aa2340cd None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.543311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887af7fd-73f2-415a-8e55-d025aa2340cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.560469 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 360/727] 10.222.0.48 () {56 vars in 1154 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:02.568605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723376fe-14a5-4a7a-9e0e-ac7421787fa1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.576188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-887af7fd-73f2-415a-8e55-d025aa2340cd None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:02.577631 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-887af7fd-73f2-415a-8e55-d025aa2340cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:02.584008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723376fe-14a5-4a7a-9e0e-ac7421787fa1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.586346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 368/728] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jan 27 16:37:02.591543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0753f7f-ab88-46ff-854a-a9d585973f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.592614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753f7f-ab88-46ff-854a-a9d585973f77 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.593111 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753f7f-ab88-46ff-854a-a9d585973f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.593587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0753f7f-ab88-46ff-854a-a9d585973f77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.604629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0753f7f-ab88-46ff-854a-a9d585973f77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.606883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0753f7f-ab88-46ff-854a-a9d585973f77 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.623603 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af7fd-73f2-415a-8e55-d025aa2340cd None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.633227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-b0753f7f-ab88-46ff-854a-a9d585973f77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:02.635671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887af7fd-73f2-415a-8e55-d025aa2340cd None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.640948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 361/729] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:02.643052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b11c8-4761-47ff-bb6d-dd89af6b0195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.648107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b11c8-4761-47ff-bb6d-dd89af6b0195 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.648397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b11c8-4761-47ff-bb6d-dd89af6b0195 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.648681 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b11c8-4761-47ff-bb6d-dd89af6b0195 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.649454 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b11c8-4761-47ff-bb6d-dd89af6b0195 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.649750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0753f7f-ab88-46ff-854a-a9d585973f77 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.650486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-5a7b11c8-4761-47ff-bb6d-dd89af6b0195 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:02.650486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:37:02.650486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:37:02.651440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b11c8-4761-47ff-bb6d-dd89af6b0195 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.663055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0753f7f-ab88-46ff-854a-a9d585973f77 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.674502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ff325-a20b-4e3f-86c3-16f409f6cd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.675651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 369/730] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:37:02 2022] POST /identity/v3/services => generated 251 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:37:02.676565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff325-a20b-4e3f-86c3-16f409f6cd50 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.677062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff325-a20b-4e3f-86c3-16f409f6cd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.677580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ff325-a20b-4e3f-86c3-16f409f6cd50 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.678579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ff325-a20b-4e3f-86c3-16f409f6cd50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:02.679106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ff325-a20b-4e3f-86c3-16f409f6cd50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.681091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ff325-a20b-4e3f-86c3-16f409f6cd50 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.694932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 362/731] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:02.701397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b11c8-4761-47ff-bb6d-dd89af6b0195 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.734352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b11c8-4761-47ff-bb6d-dd89af6b0195 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.739822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1966571-5407-437b-8343-b27595125ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.741074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1966571-5407-437b-8343-b27595125ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.741580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1966571-5407-437b-8343-b27595125ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.742120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1966571-5407-437b-8343-b27595125ef8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.750929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1966571-5407-437b-8343-b27595125ef8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.753470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1966571-5407-437b-8343-b27595125ef8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.776199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-b1966571-5407-437b-8343-b27595125ef8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:02.778088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 370/732] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:02.784986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ff325-a20b-4e3f-86c3-16f409f6cd50 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.796237 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ff325-a20b-4e3f-86c3-16f409f6cd50 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.801846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbda652-d18e-4d49-a4ad-53df4d9a6c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.802833 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbda652-d18e-4d49-a4ad-53df4d9a6c8b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.803318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbda652-d18e-4d49-a4ad-53df4d9a6c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.803860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbda652-d18e-4d49-a4ad-53df4d9a6c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.804930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbda652-d18e-4d49-a4ad-53df4d9a6c8b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:02.805451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbda652-d18e-4d49-a4ad-53df4d9a6c8b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.807645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbda652-d18e-4d49-a4ad-53df4d9a6c8b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.825203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 363/733] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:02.832283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1966571-5407-437b-8343-b27595125ef8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:02.844933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1966571-5407-437b-8343-b27595125ef8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:02.854826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c48e-bc10-47ca-a995-22afd855d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:02.856164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c48e-bc10-47ca-a995-22afd855d129 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:02.856649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c48e-bc10-47ca-a995-22afd855d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:02.857674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c48e-bc10-47ca-a995-22afd855d129 admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/8500a8d242bf43a9b2fd538c3b1bb037/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:02.865135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4c48e-bc10-47ca-a995-22afd855d129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=8500a8d242bf43a9b2fd538c3b1bb037, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:02.868270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4c48e-bc10-47ca-a995-22afd855d129 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:02.891799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 371/734] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:37:02 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/8500a8d242bf43a9b2fd538c3b1bb037/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:37:03.288520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3416-ef53-424e-b3b0-55138413747d None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.289035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3416-ef53-424e-b3b0-55138413747d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.289109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a3416-ef53-424e-b3b0-55138413747d None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.291252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 364/735] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:03.296999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c413d6-bcb9-4c5f-8639-c65627cd232d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.297923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c413d6-bcb9-4c5f-8639-c65627cd232d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.298398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c413d6-bcb9-4c5f-8639-c65627cd232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.328405 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-53c413d6-bcb9-4c5f-8639-c65627cd232d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:03.329991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-53c413d6-bcb9-4c5f-8639-c65627cd232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:03.401361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 372/736] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:03 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:03.438215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3416-ef53-424e-b3b0-55138413747d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.459543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a3416-ef53-424e-b3b0-55138413747d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.464808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85315f6-fc50-4c3e-b0d8-7e900f894586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.465598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85315f6-fc50-4c3e-b0d8-7e900f894586 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.465939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85315f6-fc50-4c3e-b0d8-7e900f894586 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.466331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85315f6-fc50-4c3e-b0d8-7e900f894586 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.488994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85315f6-fc50-4c3e-b0d8-7e900f894586 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:03.496165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-d85315f6-fc50-4c3e-b0d8-7e900f894586 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:03.500850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 365/737] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:03.505491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c413d6-bcb9-4c5f-8639-c65627cd232d None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.521959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c413d6-bcb9-4c5f-8639-c65627cd232d None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.536191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9be4cc-5483-4832-92de-33bfe5ae23db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.537145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9be4cc-5483-4832-92de-33bfe5ae23db admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.537626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9be4cc-5483-4832-92de-33bfe5ae23db admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.538113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9be4cc-5483-4832-92de-33bfe5ae23db admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.539174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9be4cc-5483-4832-92de-33bfe5ae23db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:03.539698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9be4cc-5483-4832-92de-33bfe5ae23db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:03.541546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9be4cc-5483-4832-92de-33bfe5ae23db admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:03.555258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 373/738] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:03.561438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85315f6-fc50-4c3e-b0d8-7e900f894586 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.572220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85315f6-fc50-4c3e-b0d8-7e900f894586 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.583444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235a75d-9eca-4a29-8ede-347c7299936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.584324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235a75d-9eca-4a29-8ede-347c7299936c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.584613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235a75d-9eca-4a29-8ede-347c7299936c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.584941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235a75d-9eca-4a29-8ede-347c7299936c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.598069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235a75d-9eca-4a29-8ede-347c7299936c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:03.599969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235a75d-9eca-4a29-8ede-347c7299936c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:03.620701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-a235a75d-9eca-4a29-8ede-347c7299936c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:03.622274 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 366/739] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:03.628438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9be4cc-5483-4832-92de-33bfe5ae23db admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.643779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9be4cc-5483-4832-92de-33bfe5ae23db admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.654664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee357f-cec8-4ccf-b027-48c17cb3f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.655323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee357f-cec8-4ccf-b027-48c17cb3f9af admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.655635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee357f-cec8-4ccf-b027-48c17cb3f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.655915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee357f-cec8-4ccf-b027-48c17cb3f9af admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.656648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee357f-cec8-4ccf-b027-48c17cb3f9af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:03.656955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee357f-cec8-4ccf-b027-48c17cb3f9af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:03.658541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee357f-cec8-4ccf-b027-48c17cb3f9af admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:03.665277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ef0f3-a9f1-42b7-9686-8bb3bcd0de2a None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.665568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ef0f3-a9f1-42b7-9686-8bb3bcd0de2a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.665851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ef0f3-a9f1-42b7-9686-8bb3bcd0de2a None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.670902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 367/740] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:03.680737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 374/741] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:03.683486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d88b-145e-49f8-b973-8fb24bd156f4 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.683819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d88b-145e-49f8-b973-8fb24bd156f4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.684099 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50d88b-145e-49f8-b973-8fb24bd156f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.686993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee357f-cec8-4ccf-b027-48c17cb3f9af admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.705896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee357f-cec8-4ccf-b027-48c17cb3f9af admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.714441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cc5bf-9f1f-428f-9f65-f7d2a02ac176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.715240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cc5bf-9f1f-428f-9f65-f7d2a02ac176 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.715525 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cc5bf-9f1f-428f-9f65-f7d2a02ac176 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.715830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cc5bf-9f1f-428f-9f65-f7d2a02ac176 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.726839 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-0a50d88b-145e-49f8-b973-8fb24bd156f4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:03.728099 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0a50d88b-145e-49f8-b973-8fb24bd156f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:03.731120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cc5bf-9f1f-428f-9f65-f7d2a02ac176 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:03.733367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cc5bf-9f1f-428f-9f65-f7d2a02ac176 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:03.742973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 368/742] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:03 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:03.758287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-5d0cc5bf-9f1f-428f-9f65-f7d2a02ac176 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 27 16:37:03.763676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 375/743] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:03.765997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50d88b-145e-49f8-b973-8fb24bd156f4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.775641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50d88b-145e-49f8-b973-8fb24bd156f4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.783222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40cbae-d6da-4321-8db8-830189dc4542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.784172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40cbae-d6da-4321-8db8-830189dc4542 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.784454 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40cbae-d6da-4321-8db8-830189dc4542 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.784733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40cbae-d6da-4321-8db8-830189dc4542 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.785584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40cbae-d6da-4321-8db8-830189dc4542 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:03.785895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40cbae-d6da-4321-8db8-830189dc4542 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:03.787769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40cbae-d6da-4321-8db8-830189dc4542 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:03.810808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cc5bf-9f1f-428f-9f65-f7d2a02ac176 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.813225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 369/744] 10.222.0.48 () {56 vars in 1156 bytes} [Thu Jan 27 16:37:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:03.818588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40cbae-d6da-4321-8db8-830189dc4542 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.829513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cc5bf-9f1f-428f-9f65-f7d2a02ac176 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.837551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40cbae-d6da-4321-8db8-830189dc4542 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.838849 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4d58-9247-4977-b6d1-bb500643de4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.839757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4d58-9247-4977-b6d1-bb500643de4f admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.840247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4d58-9247-4977-b6d1-bb500643de4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.840712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b4d58-9247-4977-b6d1-bb500643de4f admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.841984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4d58-9247-4977-b6d1-bb500643de4f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:03.844815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b4d58-9247-4977-b6d1-bb500643de4f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:03.852222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1e88a-4d25-4b6a-bcde-77dc78cb55b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.853266 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1e88a-4d25-4b6a-bcde-77dc78cb55b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.853796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1e88a-4d25-4b6a-bcde-77dc78cb55b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.854265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1e88a-4d25-4b6a-bcde-77dc78cb55b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.868013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 376/745] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:37:03 2022] POST /identity/v3/services => generated 240 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:37:03.869390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1e88a-4d25-4b6a-bcde-77dc78cb55b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:03.871353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1e88a-4d25-4b6a-bcde-77dc78cb55b1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:03.882962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 370/746] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:03 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:37:03.891186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4d58-9247-4977-b6d1-bb500643de4f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.914566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b4d58-9247-4977-b6d1-bb500643de4f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.919874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d10ce-fd0f-4650-919b-fb187b448bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.921246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d10ce-fd0f-4650-919b-fb187b448bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.921739 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d10ce-fd0f-4650-919b-fb187b448bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.922216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d10ce-fd0f-4650-919b-fb187b448bf3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.933371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d10ce-fd0f-4650-919b-fb187b448bf3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:03.936707 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d10ce-fd0f-4650-919b-fb187b448bf3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:03.957299 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-b72d10ce-fd0f-4650-919b-fb187b448bf3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:03.959219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 377/747] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:03.965049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1e88a-4d25-4b6a-bcde-77dc78cb55b1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:03.979443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1e88a-4d25-4b6a-bcde-77dc78cb55b1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:03.993565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eea28-4e5e-4760-896e-2193b7ee017c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:03.994257 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eea28-4e5e-4760-896e-2193b7ee017c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:03.994605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eea28-4e5e-4760-896e-2193b7ee017c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:03.994945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95eea28-4e5e-4760-896e-2193b7ee017c admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:03.995736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eea28-4e5e-4760-896e-2193b7ee017c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:03.996052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eea28-4e5e-4760-896e-2193b7ee017c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:03.998187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95eea28-4e5e-4760-896e-2193b7ee017c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.016104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 371/748] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:04.021947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d10ce-fd0f-4650-919b-fb187b448bf3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.036239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d10ce-fd0f-4650-919b-fb187b448bf3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.046556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2d5d5-2f53-4778-a442-65d3e3c577a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.047791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2d5d5-2f53-4778-a442-65d3e3c577a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.048350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2d5d5-2f53-4778-a442-65d3e3c577a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.048821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2d5d5-2f53-4778-a442-65d3e3c577a4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.060672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2d5d5-2f53-4778-a442-65d3e3c577a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.063511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2d5d5-2f53-4778-a442-65d3e3c577a4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.084234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-b0e2d5d5-2f53-4778-a442-65d3e3c577a4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:04.085814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 378/749] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:04.092397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eea28-4e5e-4760-896e-2193b7ee017c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.106219 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95eea28-4e5e-4760-896e-2193b7ee017c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.111208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8403d-b85a-40b9-b0cd-ffd1947362be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.112358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8403d-b85a-40b9-b0cd-ffd1947362be admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.112645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8403d-b85a-40b9-b0cd-ffd1947362be admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.112919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8403d-b85a-40b9-b0cd-ffd1947362be admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.113714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8403d-b85a-40b9-b0cd-ffd1947362be admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:04.114020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8403d-b85a-40b9-b0cd-ffd1947362be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.115890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8403d-b85a-40b9-b0cd-ffd1947362be admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.134496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 372/750] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:04.140805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2d5d5-2f53-4778-a442-65d3e3c577a4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.151621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2d5d5-2f53-4778-a442-65d3e3c577a4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.158003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c89c82-c092-4eaa-832b-94464d57fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.159089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c89c82-c092-4eaa-832b-94464d57fa5f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.159532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c89c82-c092-4eaa-832b-94464d57fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.160058 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c89c82-c092-4eaa-832b-94464d57fa5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.161035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c89c82-c092-4eaa-832b-94464d57fa5f admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=e14c278fc5654bb9ae7c05d4ba023262) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:04.161536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c89c82-c092-4eaa-832b-94464d57fa5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.163591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c89c82-c092-4eaa-832b-94464d57fa5f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.170985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 379/751] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/role_assignments?user.id=e14c278fc5654bb9ae7c05d4ba023262&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:04.198561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f3393-95f0-4fa9-8bc5-3e9fef440449 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.199012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f3393-95f0-4fa9-8bc5-3e9fef440449 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.199390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f3393-95f0-4fa9-8bc5-3e9fef440449 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.202530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 373/752] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:04.208131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfeb2f-ff2c-4bd0-9e95-4bd0b94f5cb5 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.208630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfeb2f-ff2c-4bd0-9e95-4bd0b94f5cb5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.209047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfeb2f-ff2c-4bd0-9e95-4bd0b94f5cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.228530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-acbfeb2f-ff2c-4bd0-9e95-4bd0b94f5cb5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:04.230057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-acbfeb2f-ff2c-4bd0-9e95-4bd0b94f5cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:04.241234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 380/753] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:04 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:04.266569 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f3393-95f0-4fa9-8bc5-3e9fef440449 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.284597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f3393-95f0-4fa9-8bc5-3e9fef440449 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.293175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8ac6a-978c-4477-b95b-c09b87e9a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.293987 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ac6a-978c-4477-b95b-c09b87e9a23d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.294271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ac6a-978c-4477-b95b-c09b87e9a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.294745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8ac6a-978c-4477-b95b-c09b87e9a23d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.312807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8ac6a-978c-4477-b95b-c09b87e9a23d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:04.319950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-47c8ac6a-978c-4477-b95b-c09b87e9a23d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:37:04.321455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 374/754] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:04.327995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfeb2f-ff2c-4bd0-9e95-4bd0b94f5cb5 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.340758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfeb2f-ff2c-4bd0-9e95-4bd0b94f5cb5 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.357659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b465961-2f6d-44ed-942f-f2a63a2e7438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.358473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b465961-2f6d-44ed-942f-f2a63a2e7438 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.358762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b465961-2f6d-44ed-942f-f2a63a2e7438 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.359042 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b465961-2f6d-44ed-942f-f2a63a2e7438 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.359861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b465961-2f6d-44ed-942f-f2a63a2e7438 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:04.360172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b465961-2f6d-44ed-942f-f2a63a2e7438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.365726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b465961-2f6d-44ed-942f-f2a63a2e7438 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.377971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 381/755] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:04.383483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8ac6a-978c-4477-b95b-c09b87e9a23d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.397473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8ac6a-978c-4477-b95b-c09b87e9a23d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.401869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ac94-0515-4291-828a-52ae5a676ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.402647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ac94-0515-4291-828a-52ae5a676ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.402925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ac94-0515-4291-828a-52ae5a676ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.403195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ac94-0515-4291-828a-52ae5a676ad8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.423230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116ac94-0515-4291-828a-52ae5a676ad8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.425096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116ac94-0515-4291-828a-52ae5a676ad8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.452575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-7116ac94-0515-4291-828a-52ae5a676ad8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:04.453782 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 375/756] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:04.459756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b465961-2f6d-44ed-942f-f2a63a2e7438 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.482957 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b465961-2f6d-44ed-942f-f2a63a2e7438 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.491694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8fe6f-fa48-4994-abc9-00779af75190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.492370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8fe6f-fa48-4994-abc9-00779af75190 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.492662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8fe6f-fa48-4994-abc9-00779af75190 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.492942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e8fe6f-fa48-4994-abc9-00779af75190 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.493689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8fe6f-fa48-4994-abc9-00779af75190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:04.493998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8fe6f-fa48-4994-abc9-00779af75190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.497188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e8fe6f-fa48-4994-abc9-00779af75190 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.512862 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 382/757] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:04.518151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ac94-0515-4291-828a-52ae5a676ad8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.533052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ac94-0515-4291-828a-52ae5a676ad8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.537655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f38b5a-f5f6-42cd-81d0-ff67abbc93ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.538447 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f38b5a-f5f6-42cd-81d0-ff67abbc93ad admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.538726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f38b5a-f5f6-42cd-81d0-ff67abbc93ad admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.539000 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f38b5a-f5f6-42cd-81d0-ff67abbc93ad admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.556683 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f38b5a-f5f6-42cd-81d0-ff67abbc93ad admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.558742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f38b5a-f5f6-42cd-81d0-ff67abbc93ad admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.579675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-d3f38b5a-f5f6-42cd-81d0-ff67abbc93ad admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 27 16:37:04.581092 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 376/758] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:04.586339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8fe6f-fa48-4994-abc9-00779af75190 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.604461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e8fe6f-fa48-4994-abc9-00779af75190 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.616178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb8a84-79f3-419c-9981-fe75b41d1760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.616857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb8a84-79f3-419c-9981-fe75b41d1760 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.617147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb8a84-79f3-419c-9981-fe75b41d1760 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.617432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb8a84-79f3-419c-9981-fe75b41d1760 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.618274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb8a84-79f3-419c-9981-fe75b41d1760 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:04.618591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb8a84-79f3-419c-9981-fe75b41d1760 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.620483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb8a84-79f3-419c-9981-fe75b41d1760 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.641937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 383/759] 10.222.0.48 () {56 vars in 1170 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:04.647087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f38b5a-f5f6-42cd-81d0-ff67abbc93ad admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.660598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f38b5a-f5f6-42cd-81d0-ff67abbc93ad admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.664918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c74a-0ae9-41c4-a567-731ea7b43040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.665550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c74a-0ae9-41c4-a567-731ea7b43040 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.665830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c74a-0ae9-41c4-a567-731ea7b43040 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.666109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85c74a-0ae9-41c4-a567-731ea7b43040 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.678368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85c74a-0ae9-41c4-a567-731ea7b43040 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.680125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85c74a-0ae9-41c4-a567-731ea7b43040 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.692529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 377/760] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:04.697881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb8a84-79f3-419c-9981-fe75b41d1760 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.712291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb8a84-79f3-419c-9981-fe75b41d1760 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.717241 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b56aae-281e-4b66-952f-87002e73f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.718014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b56aae-281e-4b66-952f-87002e73f798 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.718303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b56aae-281e-4b66-952f-87002e73f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.718623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b56aae-281e-4b66-952f-87002e73f798 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.732567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b56aae-281e-4b66-952f-87002e73f798 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.734388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b56aae-281e-4b66-952f-87002e73f798 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.754417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-78b56aae-281e-4b66-952f-87002e73f798 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:04.755585 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 384/761] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:04.760974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c74a-0ae9-41c4-a567-731ea7b43040 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.769930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85c74a-0ae9-41c4-a567-731ea7b43040 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.774270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5e77-92cd-48cc-8273-baa9b9dfe946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.774940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5e77-92cd-48cc-8273-baa9b9dfe946 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.775196 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5e77-92cd-48cc-8273-baa9b9dfe946 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.775471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec5e77-92cd-48cc-8273-baa9b9dfe946 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.776222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5e77-92cd-48cc-8273-baa9b9dfe946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:04.776522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5e77-92cd-48cc-8273-baa9b9dfe946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.778088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec5e77-92cd-48cc-8273-baa9b9dfe946 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.800544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 378/762] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:04.805582 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b56aae-281e-4b66-952f-87002e73f798 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.820409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b56aae-281e-4b66-952f-87002e73f798 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.824795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807860f-958b-4eac-98bc-6af9492d58ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.825590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807860f-958b-4eac-98bc-6af9492d58ab admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.825979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807860f-958b-4eac-98bc-6af9492d58ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.826259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807860f-958b-4eac-98bc-6af9492d58ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.836908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807860f-958b-4eac-98bc-6af9492d58ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.838804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807860f-958b-4eac-98bc-6af9492d58ab admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.854762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-a807860f-958b-4eac-98bc-6af9492d58ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:04.856122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 385/763] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:04.862327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5e77-92cd-48cc-8273-baa9b9dfe946 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.876581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec5e77-92cd-48cc-8273-baa9b9dfe946 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.880960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d0a04-40d5-438e-9c31-373a19a08062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.881610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0a04-40d5-438e-9c31-373a19a08062 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.881889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0a04-40d5-438e-9c31-373a19a08062 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.882161 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d0a04-40d5-438e-9c31-373a19a08062 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.882958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0a04-40d5-438e-9c31-373a19a08062 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:04.883265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0a04-40d5-438e-9c31-373a19a08062 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.885126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d0a04-40d5-438e-9c31-373a19a08062 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.902118 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 379/764] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:04.908547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807860f-958b-4eac-98bc-6af9492d58ab admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:04.921187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807860f-958b-4eac-98bc-6af9492d58ab admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:04.928997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ac4c-bc91-4f0c-b2b4-a5999c490467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:04.929651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ac4c-bc91-4f0c-b2b4-a5999c490467 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:04.929934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ac4c-bc91-4f0c-b2b4-a5999c490467 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:04.930208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ac4c-bc91-4f0c-b2b4-a5999c490467 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:04.931057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ac4c-bc91-4f0c-b2b4-a5999c490467 admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=531ce85d5104400fa5adec42d30f399b) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:04.931367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ac4c-bc91-4f0c-b2b4-a5999c490467 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:04.933353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ac4c-bc91-4f0c-b2b4-a5999c490467 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:04.939532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 386/765] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:04 2022] GET /identity/v3/role_assignments?user.id=531ce85d5104400fa5adec42d30f399b&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:05.636758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07232603-860a-401b-bf30-3a298e07bf2e None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:05.637324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07232603-860a-401b-bf30-3a298e07bf2e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:05.637324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07232603-860a-401b-bf30-3a298e07bf2e None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:05.640019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 380/766] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:05.645976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b1e8-36ca-4cd8-9c02-b0c997d29990 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:05.646548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b1e8-36ca-4cd8-9c02-b0c997d29990 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:05.646548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50b1e8-36ca-4cd8-9c02-b0c997d29990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:05.672581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3d50b1e8-36ca-4cd8-9c02-b0c997d29990 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:05.673801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3d50b1e8-36ca-4cd8-9c02-b0c997d29990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:05.681834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 387/767] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:05 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:05.726312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07232603-860a-401b-bf30-3a298e07bf2e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:05.741767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07232603-860a-401b-bf30-3a298e07bf2e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:05.751532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96534b9-0c37-40e5-b2dd-8820bfae593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:05.752363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96534b9-0c37-40e5-b2dd-8820bfae593b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:05.752648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96534b9-0c37-40e5-b2dd-8820bfae593b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:05.752923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96534b9-0c37-40e5-b2dd-8820bfae593b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:05.769272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96534b9-0c37-40e5-b2dd-8820bfae593b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:05.776076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-f96534b9-0c37-40e5-b2dd-8820bfae593b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:05.777555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 381/768] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:05.783138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b1e8-36ca-4cd8-9c02-b0c997d29990 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:05.792700 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50b1e8-36ca-4cd8-9c02-b0c997d29990 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:05.803726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16852f-7393-4c11-befd-7c8c48b1a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:05.804340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16852f-7393-4c11-befd-7c8c48b1a15f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:05.804628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16852f-7393-4c11-befd-7c8c48b1a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:05.804907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16852f-7393-4c11-befd-7c8c48b1a15f admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:05.805677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16852f-7393-4c11-befd-7c8c48b1a15f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:05.805981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16852f-7393-4c11-befd-7c8c48b1a15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:05.807693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16852f-7393-4c11-befd-7c8c48b1a15f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:05.823472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 388/769] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:05.829273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96534b9-0c37-40e5-b2dd-8820bfae593b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:05.844570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96534b9-0c37-40e5-b2dd-8820bfae593b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:05.851594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21a48a-32a9-4b70-bd0e-0065f3d9c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:05.852368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21a48a-32a9-4b70-bd0e-0065f3d9c8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:05.852649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21a48a-32a9-4b70-bd0e-0065f3d9c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:05.852930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21a48a-32a9-4b70-bd0e-0065f3d9c8b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:05.871259 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21a48a-32a9-4b70-bd0e-0065f3d9c8b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:05.873793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21a48a-32a9-4b70-bd0e-0065f3d9c8b0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:05.899084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-4c21a48a-32a9-4b70-bd0e-0065f3d9c8b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:05.900613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 382/770] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:05.905899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16852f-7393-4c11-befd-7c8c48b1a15f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:05.921773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16852f-7393-4c11-befd-7c8c48b1a15f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:05.933071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec3080-72cb-4a26-89e6-8749e7c941a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:05.933748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3080-72cb-4a26-89e6-8749e7c941a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:05.934033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3080-72cb-4a26-89e6-8749e7c941a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:05.934313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec3080-72cb-4a26-89e6-8749e7c941a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:05.935092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec3080-72cb-4a26-89e6-8749e7c941a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:05.935430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec3080-72cb-4a26-89e6-8749e7c941a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:05.937072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec3080-72cb-4a26-89e6-8749e7c941a4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:05.958504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 389/771] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:05.963898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21a48a-32a9-4b70-bd0e-0065f3d9c8b0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:05.976507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21a48a-32a9-4b70-bd0e-0065f3d9c8b0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:05.983998 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687785ca-520d-437c-b044-810a3de7e357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:05.984794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687785ca-520d-437c-b044-810a3de7e357 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:05.985080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687785ca-520d-437c-b044-810a3de7e357 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:05.985361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687785ca-520d-437c-b044-810a3de7e357 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.004048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687785ca-520d-437c-b044-810a3de7e357 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.006090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687785ca-520d-437c-b044-810a3de7e357 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.021157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-687785ca-520d-437c-b044-810a3de7e357 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 27 16:37:06.022696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 383/772] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jan 27 16:37:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:06.027992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec3080-72cb-4a26-89e6-8749e7c941a4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.041251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec3080-72cb-4a26-89e6-8749e7c941a4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.057380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c21d09-09fb-418f-99ed-a0160a98fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.057995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c21d09-09fb-418f-99ed-a0160a98fe4a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.058279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c21d09-09fb-418f-99ed-a0160a98fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.058558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c21d09-09fb-418f-99ed-a0160a98fe4a admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.059416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c21d09-09fb-418f-99ed-a0160a98fe4a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:06.059753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c21d09-09fb-418f-99ed-a0160a98fe4a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.062153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c21d09-09fb-418f-99ed-a0160a98fe4a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.088194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 390/773] 10.222.0.48 () {56 vars in 1154 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:06.095684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687785ca-520d-437c-b044-810a3de7e357 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.109784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687785ca-520d-437c-b044-810a3de7e357 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.110067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc58ea-5351-485a-bffe-ad5889f07de2 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.110231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc58ea-5351-485a-bffe-ad5889f07de2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.110469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc58ea-5351-485a-bffe-ad5889f07de2 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.112515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 391/774] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:06.117575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a73ef-b3d8-4519-b7ff-e2e2f84b4e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.118225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a73ef-b3d8-4519-b7ff-e2e2f84b4e0a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.118507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a73ef-b3d8-4519-b7ff-e2e2f84b4e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.118797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a73ef-b3d8-4519-b7ff-e2e2f84b4e0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.120075 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e0248-ff07-4bb9-9518-e19f2f69a30d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.120534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e0248-ff07-4bb9-9518-e19f2f69a30d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.120971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e0248-ff07-4bb9-9518-e19f2f69a30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.131519 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a73ef-b3d8-4519-b7ff-e2e2f84b4e0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.136934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7a73ef-b3d8-4519-b7ff-e2e2f84b4e0a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.141052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b02e0248-ff07-4bb9-9518-e19f2f69a30d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:06.142413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b02e0248-ff07-4bb9-9518-e19f2f69a30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:06.151036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 384/775] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:37:06.152535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a73ef-b3d8-4519-b7ff-e2e2f84b4e0a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.164520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a73ef-b3d8-4519-b7ff-e2e2f84b4e0a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.167617 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 392/776] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:06.178557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f6fb5-a487-49a2-901d-9b547d0804a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.179534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f6fb5-a487-49a2-901d-9b547d0804a4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.179991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f6fb5-a487-49a2-901d-9b547d0804a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.180442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f6fb5-a487-49a2-901d-9b547d0804a4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.195604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f6fb5-a487-49a2-901d-9b547d0804a4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.195604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f6fb5-a487-49a2-901d-9b547d0804a4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.196825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e0248-ff07-4bb9-9518-e19f2f69a30d None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.206131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e0248-ff07-4bb9-9518-e19f2f69a30d None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.218695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.219502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.219812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.220091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.220766 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.221797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:06.221797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:37:06.221797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:37:06.222683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.244115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 27 16:37:06.245434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 393/777] 10.222.0.48 () {56 vars in 1150 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:06.246175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-5e1f6fb5-a487-49a2-901d-9b547d0804a4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:06.251759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 385/778] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:06.253202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.263427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f372d-7143-42b4-96c1-8b6df5e88718 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.266401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f6fb5-a487-49a2-901d-9b547d0804a4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.276597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f6fb5-a487-49a2-901d-9b547d0804a4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.281805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc666e4-d5c1-4879-b8b6-f3aa781ad4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.282494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc666e4-d5c1-4879-b8b6-f3aa781ad4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.282780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc666e4-d5c1-4879-b8b6-f3aa781ad4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.283062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc666e4-d5c1-4879-b8b6-f3aa781ad4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.283843 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc666e4-d5c1-4879-b8b6-f3aa781ad4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:06.284408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc666e4-d5c1-4879-b8b6-f3aa781ad4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.287456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc666e4-d5c1-4879-b8b6-f3aa781ad4a0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.290336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b362c-bfc4-439a-8a45-65397315e1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.291242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b362c-bfc4-439a-8a45-65397315e1da admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.291733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b362c-bfc4-439a-8a45-65397315e1da admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.292192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b362c-bfc4-439a-8a45-65397315e1da admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.293104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b362c-bfc4-439a-8a45-65397315e1da admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:06.293611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b362c-bfc4-439a-8a45-65397315e1da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.296066 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b362c-bfc4-439a-8a45-65397315e1da admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.302692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 394/779] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:06.306773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 386/780] 10.222.0.48 () {56 vars in 1145 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:06.308809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc666e4-d5c1-4879-b8b6-f3aa781ad4a0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.313439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b362c-bfc4-439a-8a45-65397315e1da admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.321505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc666e4-d5c1-4879-b8b6-f3aa781ad4a0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.331586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0774ba-a1a3-4ccc-8426-e9ff6e573c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.331586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0774ba-a1a3-4ccc-8426-e9ff6e573c64 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.331586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0774ba-a1a3-4ccc-8426-e9ff6e573c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.331586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0774ba-a1a3-4ccc-8426-e9ff6e573c64 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.332254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b362c-bfc4-439a-8a45-65397315e1da admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.336617 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0774ba-a1a3-4ccc-8426-e9ff6e573c64 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.338257 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949f66c-c2b2-4eb3-9cda-9dd6a0a066ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.338959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0774ba-a1a3-4ccc-8426-e9ff6e573c64 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.339328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949f66c-c2b2-4eb3-9cda-9dd6a0a066ca admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.339828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949f66c-c2b2-4eb3-9cda-9dd6a0a066ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.340300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949f66c-c2b2-4eb3-9cda-9dd6a0a066ca admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.341195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949f66c-c2b2-4eb3-9cda-9dd6a0a066ca admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:06.342242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949f66c-c2b2-4eb3-9cda-9dd6a0a066ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.344119 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949f66c-c2b2-4eb3-9cda-9dd6a0a066ca admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.352901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-9e0774ba-a1a3-4ccc-8426-e9ff6e573c64 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:06.354356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 395/781] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:06.355521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 387/782] 10.222.0.48 () {56 vars in 1145 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:06.364876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0774ba-a1a3-4ccc-8426-e9ff6e573c64 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.365061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949f66c-c2b2-4eb3-9cda-9dd6a0a066ca admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.375614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949f66c-c2b2-4eb3-9cda-9dd6a0a066ca admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.375819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0774ba-a1a3-4ccc-8426-e9ff6e573c64 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.381127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.381806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.382095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.382378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.383186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] RBAC: Adding query filter params (interface=public, service_id=f025c53bd8f24359bd65fb9955f4b04d, region_id=RegionOne) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:06.383500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.387391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe26322-07cc-4921-bb30-c64df77fadcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.388089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe26322-07cc-4921-bb30-c64df77fadcb admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.388506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe26322-07cc-4921-bb30-c64df77fadcb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.388789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe26322-07cc-4921-bb30-c64df77fadcb admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.389695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe26322-07cc-4921-bb30-c64df77fadcb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:06.390011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe26322-07cc-4921-bb30-c64df77fadcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.391897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe26322-07cc-4921-bb30-c64df77fadcb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.394661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:06.394661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:37:06.394661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:37:06.395547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.409973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 396/783] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:06.411319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 388/784] 10.222.0.48 () {56 vars in 1272 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/endpoints?service_id=f025c53bd8f24359bd65fb9955f4b04d&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:06.420918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.421105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe26322-07cc-4921-bb30-c64df77fadcb admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.431624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe26322-07cc-4921-bb30-c64df77fadcb admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.437065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c2a3c-d7fe-4978-924b-e3e76f9674fe admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.447364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2c997-8616-458b-b2cd-a72eaef8ef68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.447760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba3fc6-d995-4b62-96c8-b1f0e7d79099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.449004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba3fc6-d995-4b62-96c8-b1f0e7d79099 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.449312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2c997-8616-458b-b2cd-a72eaef8ef68 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.449594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2c997-8616-458b-b2cd-a72eaef8ef68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.449867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2c997-8616-458b-b2cd-a72eaef8ef68 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.451351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba3fc6-d995-4b62-96c8-b1f0e7d79099 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.451766 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba3fc6-d995-4b62-96c8-b1f0e7d79099 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.452821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba3fc6-d995-4b62-96c8-b1f0e7d79099 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=8500a8d242bf43a9b2fd538c3b1bb037) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:06.453045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2c997-8616-458b-b2cd-a72eaef8ef68 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.454541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba3fc6-d995-4b62-96c8-b1f0e7d79099 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.455353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2c997-8616-458b-b2cd-a72eaef8ef68 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.458167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba3fc6-d995-4b62-96c8-b1f0e7d79099 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.467115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 389/785] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/services => generated 772 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:06.474304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 397/786] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/role_assignments?user.id=8500a8d242bf43a9b2fd538c3b1bb037&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:06.705509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0f370-3983-4c59-b174-3f8c751d1b43 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.706199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0f370-3983-4c59-b174-3f8c751d1b43 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.706199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0f370-3983-4c59-b174-3f8c751d1b43 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.707862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 390/787] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:06.726917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d714ee-4142-4061-9b65-beac38cb1827 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.727592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d714ee-4142-4061-9b65-beac38cb1827 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.727764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d714ee-4142-4061-9b65-beac38cb1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.751920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e9d714ee-4142-4061-9b65-beac38cb1827 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:06.753444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e9d714ee-4142-4061-9b65-beac38cb1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:06.761834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 398/788] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:06.787251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0f370-3983-4c59-b174-3f8c751d1b43 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.803552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0f370-3983-4c59-b174-3f8c751d1b43 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.808131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b03d6-0315-4c50-850a-25fb06d3a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.808943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b03d6-0315-4c50-850a-25fb06d3a542 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.809289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b03d6-0315-4c50-850a-25fb06d3a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.809573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b03d6-0315-4c50-850a-25fb06d3a542 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.821276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b03d6-0315-4c50-850a-25fb06d3a542 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:06.828834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-414b03d6-0315-4c50-850a-25fb06d3a542 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:06.830517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 391/789] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:06.836394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d714ee-4142-4061-9b65-beac38cb1827 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.845986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d714ee-4142-4061-9b65-beac38cb1827 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.850595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d32fa3-838d-4dd4-aef5-b2860658097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.851318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d32fa3-838d-4dd4-aef5-b2860658097a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.851634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d32fa3-838d-4dd4-aef5-b2860658097a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.851916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d32fa3-838d-4dd4-aef5-b2860658097a admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.852730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d32fa3-838d-4dd4-aef5-b2860658097a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:06.853037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d32fa3-838d-4dd4-aef5-b2860658097a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.854679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d32fa3-838d-4dd4-aef5-b2860658097a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.864711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 399/790] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:06.870349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b03d6-0315-4c50-850a-25fb06d3a542 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.880604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b03d6-0315-4c50-850a-25fb06d3a542 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.885351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e802530-7b95-4833-a3fa-341156b2148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.886200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e802530-7b95-4833-a3fa-341156b2148f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.886484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e802530-7b95-4833-a3fa-341156b2148f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.886813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e802530-7b95-4833-a3fa-341156b2148f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.898477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e802530-7b95-4833-a3fa-341156b2148f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.900407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e802530-7b95-4833-a3fa-341156b2148f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.919212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-4e802530-7b95-4833-a3fa-341156b2148f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:06.921434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 392/791] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:06.927253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d32fa3-838d-4dd4-aef5-b2860658097a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.930822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c82f1d-5cdd-4bd9-be22-b5388bdd46fa None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.931117 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c82f1d-5cdd-4bd9-be22-b5388bdd46fa None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.931409 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c82f1d-5cdd-4bd9-be22-b5388bdd46fa None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.933644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 393/792] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:06.939862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97a33-19c6-459c-b6e7-56c989b8b5b4 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.940159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97a33-19c6-459c-b6e7-56c989b8b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.940421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d32fa3-838d-4dd4-aef5-b2860658097a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.940526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f97a33-19c6-459c-b6e7-56c989b8b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.945727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd9455-5450-4733-80d0-010edfa46c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.946392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9455-5450-4733-80d0-010edfa46c25 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.946761 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9455-5450-4733-80d0-010edfa46c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.947050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd9455-5450-4733-80d0-010edfa46c25 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.947945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd9455-5450-4733-80d0-010edfa46c25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:06.948263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd9455-5450-4733-80d0-010edfa46c25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:06.949886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd9455-5450-4733-80d0-010edfa46c25 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:06.962618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-f1f97a33-19c6-459c-b6e7-56c989b8b5b4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:06.963787 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f1f97a33-19c6-459c-b6e7-56c989b8b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:06.964353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 400/793] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:06.969510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd9455-5450-4733-80d0-010edfa46c25 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.973532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 394/794] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:06 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:06.981083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd9455-5450-4733-80d0-010edfa46c25 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:06.986311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bdb16-ef98-4a72-a9c3-3055d35ed574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:06.987271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bdb16-ef98-4a72-a9c3-3055d35ed574 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:06.987659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bdb16-ef98-4a72-a9c3-3055d35ed574 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:06.988040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bdb16-ef98-4a72-a9c3-3055d35ed574 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:06.996907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f97a33-19c6-459c-b6e7-56c989b8b5b4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:06.997509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bdb16-ef98-4a72-a9c3-3055d35ed574 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.000313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8bdb16-ef98-4a72-a9c3-3055d35ed574 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.006457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f97a33-19c6-459c-b6e7-56c989b8b5b4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.012159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c609d-c12e-4f44-b245-238534d8a497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.012952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c609d-c12e-4f44-b245-238534d8a497 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.013877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c609d-c12e-4f44-b245-238534d8a497 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.014170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c609d-c12e-4f44-b245-238534d8a497 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.014963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c609d-c12e-4f44-b245-238534d8a497 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.016186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-0a8bdb16-ef98-4a72-a9c3-3055d35ed574 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 27 16:37:07.016596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c609d-c12e-4f44-b245-238534d8a497 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.018008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 401/795] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:07.024104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bdb16-ef98-4a72-a9c3-3055d35ed574 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.029060 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-bd8c609d-c12e-4f44-b245-238534d8a497 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 27 16:37:07.030816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 395/796] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:06 2022] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:07.035977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bdb16-ef98-4a72-a9c3-3055d35ed574 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.036866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c609d-c12e-4f44-b245-238534d8a497 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.041391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b2452-2258-4d0c-85c3-a7ad608c362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.042186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b2452-2258-4d0c-85c3-a7ad608c362c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.042586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b2452-2258-4d0c-85c3-a7ad608c362c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.042941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b2452-2258-4d0c-85c3-a7ad608c362c admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.043978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b2452-2258-4d0c-85c3-a7ad608c362c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:07.044362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b2452-2258-4d0c-85c3-a7ad608c362c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.046506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b2452-2258-4d0c-85c3-a7ad608c362c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.055440 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c609d-c12e-4f44-b245-238534d8a497 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.065955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 402/797] 10.222.0.48 () {56 vars in 1156 bytes} [Thu Jan 27 16:37:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:07.066996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da9c3a-6a0a-40e8-a65e-ad5b988adc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.067700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da9c3a-6a0a-40e8-a65e-ad5b988adc13 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.067989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da9c3a-6a0a-40e8-a65e-ad5b988adc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.068271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da9c3a-6a0a-40e8-a65e-ad5b988adc13 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.068995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da9c3a-6a0a-40e8-a65e-ad5b988adc13 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:07.069306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da9c3a-6a0a-40e8-a65e-ad5b988adc13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.070948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da9c3a-6a0a-40e8-a65e-ad5b988adc13 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.071189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b2452-2258-4d0c-85c3-a7ad608c362c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.082148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b2452-2258-4d0c-85c3-a7ad608c362c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.085561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 396/798] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:07.087593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baabfa4-2803-48ae-a728-c800f07c134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.088594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baabfa4-2803-48ae-a728-c800f07c134d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.089103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baabfa4-2803-48ae-a728-c800f07c134d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.089571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baabfa4-2803-48ae-a728-c800f07c134d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.091047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da9c3a-6a0a-40e8-a65e-ad5b988adc13 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.101522 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baabfa4-2803-48ae-a728-c800f07c134d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.103711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baabfa4-2803-48ae-a728-c800f07c134d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.113963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da9c3a-6a0a-40e8-a65e-ad5b988adc13 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.121784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-9baabfa4-2803-48ae-a728-c800f07c134d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:07.124428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 403/799] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:07.127758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413840d9-2d15-47c1-a061-9841c9b108c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.129642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baabfa4-2803-48ae-a728-c800f07c134d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.130722 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413840d9-2d15-47c1-a061-9841c9b108c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.132951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413840d9-2d15-47c1-a061-9841c9b108c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.133660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413840d9-2d15-47c1-a061-9841c9b108c5 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.134619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413840d9-2d15-47c1-a061-9841c9b108c5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:07.136584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413840d9-2d15-47c1-a061-9841c9b108c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.140434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413840d9-2d15-47c1-a061-9841c9b108c5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.148483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baabfa4-2803-48ae-a728-c800f07c134d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.150944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 397/800] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:07.156856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413840d9-2d15-47c1-a061-9841c9b108c5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.157771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a448f-dec0-47a3-b6b6-2df49fdd27f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.162801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a448f-dec0-47a3-b6b6-2df49fdd27f7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.163324 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a448f-dec0-47a3-b6b6-2df49fdd27f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.164452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a448f-dec0-47a3-b6b6-2df49fdd27f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.165409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a448f-dec0-47a3-b6b6-2df49fdd27f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:07.166474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a448f-dec0-47a3-b6b6-2df49fdd27f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.170480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a448f-dec0-47a3-b6b6-2df49fdd27f7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.173183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413840d9-2d15-47c1-a061-9841c9b108c5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.178736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0873c-195d-4180-97ea-1be085e4d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.179695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0873c-195d-4180-97ea-1be085e4d19c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.180181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0873c-195d-4180-97ea-1be085e4d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.180728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0873c-195d-4180-97ea-1be085e4d19c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.181726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0873c-195d-4180-97ea-1be085e4d19c admin admin] RBAC: Adding query filter params (interface=public, service_id=c163023d31d442f48bfd9654349197e6, region_id=RegionOne) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:07.182723 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0873c-195d-4180-97ea-1be085e4d19c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.184589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0873c-195d-4180-97ea-1be085e4d19c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.192002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 398/801] 10.222.0.48 () {56 vars in 1272 bytes} [Thu Jan 27 16:37:07 2022] GET /identity/v3/endpoints?service_id=c163023d31d442f48bfd9654349197e6&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:07.196533 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 404/802] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:07.197714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0873c-195d-4180-97ea-1be085e4d19c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.205216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a448f-dec0-47a3-b6b6-2df49fdd27f7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.208882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0873c-195d-4180-97ea-1be085e4d19c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.221478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cce44-7435-4c5a-b5f5-c5e1e3a714fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.222386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cce44-7435-4c5a-b5f5-c5e1e3a714fe admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.222913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cce44-7435-4c5a-b5f5-c5e1e3a714fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.223375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436cce44-7435-4c5a-b5f5-c5e1e3a714fe admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.224339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cce44-7435-4c5a-b5f5-c5e1e3a714fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.226559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a448f-dec0-47a3-b6b6-2df49fdd27f7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.228061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436cce44-7435-4c5a-b5f5-c5e1e3a714fe admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.235796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea510e-555c-4e1e-b836-99fd24fb2033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.238485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea510e-555c-4e1e-b836-99fd24fb2033 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.238953 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea510e-555c-4e1e-b836-99fd24fb2033 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.239459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea510e-555c-4e1e-b836-99fd24fb2033 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.241156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 399/803] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:37:07 2022] GET /identity/v3/services => generated 772 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:07.249895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea510e-555c-4e1e-b836-99fd24fb2033 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.252384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea510e-555c-4e1e-b836-99fd24fb2033 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.268273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-f9ea510e-555c-4e1e-b836-99fd24fb2033 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:07.269840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 405/804] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:07.276155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cce44-7435-4c5a-b5f5-c5e1e3a714fe admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.289502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436cce44-7435-4c5a-b5f5-c5e1e3a714fe admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.297187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbd6c9-6983-4a1c-b95b-1fbfd9975679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.298213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbd6c9-6983-4a1c-b95b-1fbfd9975679 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.298681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbd6c9-6983-4a1c-b95b-1fbfd9975679 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.299159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbd6c9-6983-4a1c-b95b-1fbfd9975679 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.300261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbd6c9-6983-4a1c-b95b-1fbfd9975679 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:07.300764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbd6c9-6983-4a1c-b95b-1fbfd9975679 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.302926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbd6c9-6983-4a1c-b95b-1fbfd9975679 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.321318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 400/805] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:07.328547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea510e-555c-4e1e-b836-99fd24fb2033 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:07.339153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea510e-555c-4e1e-b836-99fd24fb2033 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:07.344931 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634a59e-580f-4558-950c-6e98eff622c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:07.346182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634a59e-580f-4558-950c-6e98eff622c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.346657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634a59e-580f-4558-950c-6e98eff622c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.347160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634a59e-580f-4558-950c-6e98eff622c7 admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/e14c278fc5654bb9ae7c05d4ba023262/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.349632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634a59e-580f-4558-950c-6e98eff622c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=e14c278fc5654bb9ae7c05d4ba023262, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:07.352626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634a59e-580f-4558-950c-6e98eff622c7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:07.376502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 406/806] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:37:07 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/e14c278fc5654bb9ae7c05d4ba023262/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:37:07.906678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05259e-df53-43c5-8af8-003de3523416 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.906678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05259e-df53-43c5-8af8-003de3523416 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.906678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05259e-df53-43c5-8af8-003de3523416 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.907885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 401/807] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:07.912919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfc007-5780-4a1b-99aa-780a5c015a85 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:07.913760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfc007-5780-4a1b-99aa-780a5c015a85 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:07.914264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfc007-5780-4a1b-99aa-780a5c015a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:07.944647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7fdfc007-5780-4a1b-99aa-780a5c015a85 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:07.946210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7fdfc007-5780-4a1b-99aa-780a5c015a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:08.036656 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 407/808] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:07 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:08.078973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05259e-df53-43c5-8af8-003de3523416 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.094682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05259e-df53-43c5-8af8-003de3523416 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.099185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d034081-e2e3-4b08-a86c-61933955f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.100108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d034081-e2e3-4b08-a86c-61933955f968 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.100398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d034081-e2e3-4b08-a86c-61933955f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.100811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d034081-e2e3-4b08-a86c-61933955f968 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.113361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d034081-e2e3-4b08-a86c-61933955f968 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:08.120646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-8d034081-e2e3-4b08-a86c-61933955f968 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:37:08.122417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 402/809] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:08.129959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfc007-5780-4a1b-99aa-780a5c015a85 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.144847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfc007-5780-4a1b-99aa-780a5c015a85 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.152773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe61599-1af0-4e07-ba68-8c9ab6548ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.155059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe61599-1af0-4e07-ba68-8c9ab6548ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.155344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe61599-1af0-4e07-ba68-8c9ab6548ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.155645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe61599-1af0-4e07-ba68-8c9ab6548ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.156418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe61599-1af0-4e07-ba68-8c9ab6548ff8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:08.156774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe61599-1af0-4e07-ba68-8c9ab6548ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.162417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe61599-1af0-4e07-ba68-8c9ab6548ff8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.173236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 408/810] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:08.178505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d034081-e2e3-4b08-a86c-61933955f968 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.192507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d034081-e2e3-4b08-a86c-61933955f968 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.198560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9888-238c-4d3c-aa6d-5cf328c6bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.199347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9888-238c-4d3c-aa6d-5cf328c6bd30 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.199710 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9888-238c-4d3c-aa6d-5cf328c6bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.199993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba9888-238c-4d3c-aa6d-5cf328c6bd30 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.219204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9888-238c-4d3c-aa6d-5cf328c6bd30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.221128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba9888-238c-4d3c-aa6d-5cf328c6bd30 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.245762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-abba9888-238c-4d3c-aa6d-5cf328c6bd30 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:08.247326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 403/811] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:08.252756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe61599-1af0-4e07-ba68-8c9ab6548ff8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.262759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe61599-1af0-4e07-ba68-8c9ab6548ff8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.271892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a1c83-0b40-48ee-9328-bdb73408a6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.272558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1c83-0b40-48ee-9328-bdb73408a6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.272897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1c83-0b40-48ee-9328-bdb73408a6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.273177 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a1c83-0b40-48ee-9328-bdb73408a6f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.273955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a1c83-0b40-48ee-9328-bdb73408a6f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:08.274266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a1c83-0b40-48ee-9328-bdb73408a6f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.275960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48a1c83-0b40-48ee-9328-bdb73408a6f1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.294125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 409/812] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:08.299396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9888-238c-4d3c-aa6d-5cf328c6bd30 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.311041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba9888-238c-4d3c-aa6d-5cf328c6bd30 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.317361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8043d-6535-4be5-bc10-edf36b91a65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.318220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8043d-6535-4be5-bc10-edf36b91a65b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.318504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8043d-6535-4be5-bc10-edf36b91a65b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.318783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8043d-6535-4be5-bc10-edf36b91a65b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.331536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8043d-6535-4be5-bc10-edf36b91a65b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.333769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8043d-6535-4be5-bc10-edf36b91a65b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.352802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-96a8043d-6535-4be5-bc10-edf36b91a65b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 27 16:37:08.354363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 404/813] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:08.360305 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a1c83-0b40-48ee-9328-bdb73408a6f1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.370420 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a1c83-0b40-48ee-9328-bdb73408a6f1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.375052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89039888-979c-4b58-8930-9b5807ad3fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.375821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89039888-979c-4b58-8930-9b5807ad3fdf admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.376105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89039888-979c-4b58-8930-9b5807ad3fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.376434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89039888-979c-4b58-8930-9b5807ad3fdf admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.377398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89039888-979c-4b58-8930-9b5807ad3fdf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:08.377705 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89039888-979c-4b58-8930-9b5807ad3fdf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.383651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89039888-979c-4b58-8930-9b5807ad3fdf admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.407408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 410/814] 10.222.0.48 () {56 vars in 1170 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:08.412882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8043d-6535-4be5-bc10-edf36b91a65b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.424290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8043d-6535-4be5-bc10-edf36b91a65b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.430887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d4e25-6f0d-4b5e-8260-6c8e04948b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.431757 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d4e25-6f0d-4b5e-8260-6c8e04948b0b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.432045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d4e25-6f0d-4b5e-8260-6c8e04948b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.432370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d4e25-6f0d-4b5e-8260-6c8e04948b0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.446212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d4e25-6f0d-4b5e-8260-6c8e04948b0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.448138 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d4e25-6f0d-4b5e-8260-6c8e04948b0b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.465472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-8b5d4e25-6f0d-4b5e-8260-6c8e04948b0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:08.467596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 405/815] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:08.472631 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89039888-979c-4b58-8930-9b5807ad3fdf admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.483432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89039888-979c-4b58-8930-9b5807ad3fdf admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.487984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eabeb1-1bd4-4dfb-85cc-5a21526e6027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.488698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eabeb1-1bd4-4dfb-85cc-5a21526e6027 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.488983 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eabeb1-1bd4-4dfb-85cc-5a21526e6027 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.489267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eabeb1-1bd4-4dfb-85cc-5a21526e6027 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.490065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eabeb1-1bd4-4dfb-85cc-5a21526e6027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:08.490380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eabeb1-1bd4-4dfb-85cc-5a21526e6027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.492110 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eabeb1-1bd4-4dfb-85cc-5a21526e6027 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.510267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 411/816] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:08.520685 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d4e25-6f0d-4b5e-8260-6c8e04948b0b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.531645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d4e25-6f0d-4b5e-8260-6c8e04948b0b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.536471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69362df9-4876-4154-8351-d20e7afa21ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.537311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69362df9-4876-4154-8351-d20e7afa21ee admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.537589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69362df9-4876-4154-8351-d20e7afa21ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.537918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69362df9-4876-4154-8351-d20e7afa21ee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.556338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69362df9-4876-4154-8351-d20e7afa21ee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.558358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69362df9-4876-4154-8351-d20e7afa21ee admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.575190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-69362df9-4876-4154-8351-d20e7afa21ee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:08.576852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 406/817] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:08.582179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eabeb1-1bd4-4dfb-85cc-5a21526e6027 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.592904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eabeb1-1bd4-4dfb-85cc-5a21526e6027 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.597460 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c5531-5dff-4c3e-a1de-9c6a243ea5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.598167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c5531-5dff-4c3e-a1de-9c6a243ea5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.598451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c5531-5dff-4c3e-a1de-9c6a243ea5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.598781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c5531-5dff-4c3e-a1de-9c6a243ea5c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.599603 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c5531-5dff-4c3e-a1de-9c6a243ea5c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:08.608168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c5531-5dff-4c3e-a1de-9c6a243ea5c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.608168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c5531-5dff-4c3e-a1de-9c6a243ea5c8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.620063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 412/818] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:08.627236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69362df9-4876-4154-8351-d20e7afa21ee admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:08.640812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69362df9-4876-4154-8351-d20e7afa21ee admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:08.648967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6bd31-da67-4fa7-8726-afd1eebbfcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:08.649869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6bd31-da67-4fa7-8726-afd1eebbfcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:08.650152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6bd31-da67-4fa7-8726-afd1eebbfcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:08.650430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6bd31-da67-4fa7-8726-afd1eebbfcaa admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/531ce85d5104400fa5adec42d30f399b/roles/a22d2094a5364a8ba169d8e80f4402c5` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:08.670808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6bd31-da67-4fa7-8726-afd1eebbfcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=531ce85d5104400fa5adec42d30f399b, role_id=a22d2094a5364a8ba169d8e80f4402c5)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:08.673422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6bd31-da67-4fa7-8726-afd1eebbfcaa admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:08.693055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 407/819] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:37:08 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/531ce85d5104400fa5adec42d30f399b/roles/a22d2094a5364a8ba169d8e80f4402c5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:37:09.239322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6635cbc-5bd8-418e-a580-34375d0029f7 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.240389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6635cbc-5bd8-418e-a580-34375d0029f7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.240906 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6635cbc-5bd8-418e-a580-34375d0029f7 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.243135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 413/820] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:09.249418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b665-fd39-458d-973f-7e70dc323884 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.250227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b665-fd39-458d-973f-7e70dc323884 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.250745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b665-fd39-458d-973f-7e70dc323884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.268877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e5a5b665-fd39-458d-973f-7e70dc323884 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:09.270405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e5a5b665-fd39-458d-973f-7e70dc323884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:09.350217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 408/821] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:09 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:09.392904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6635cbc-5bd8-418e-a580-34375d0029f7 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:09.410989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6635cbc-5bd8-418e-a580-34375d0029f7 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:09.422174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdb28a-9e8c-4483-a291-0936f287abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:09.423360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdb28a-9e8c-4483-a291-0936f287abc8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.423904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdb28a-9e8c-4483-a291-0936f287abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.424401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdb28a-9e8c-4483-a291-0936f287abc8 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.425359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdb28a-9e8c-4483-a291-0936f287abc8 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:09.427243 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdb28a-9e8c-4483-a291-0936f287abc8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:09.445094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-abcdb28a-9e8c-4483-a291-0936f287abc8 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jan 27 16:37:09.446665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 414/822] 10.222.0.48 () {56 vars in 1150 bytes} [Thu Jan 27 16:37:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:09.453310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b665-fd39-458d-973f-7e70dc323884 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:09.462887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b665-fd39-458d-973f-7e70dc323884 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:09.470729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d0800-e0e4-43d2-83ef-0865817abc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:09.472193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d0800-e0e4-43d2-83ef-0865817abc60 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.472686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d0800-e0e4-43d2-83ef-0865817abc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.473164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d0800-e0e4-43d2-83ef-0865817abc60 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.474117 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d0800-e0e4-43d2-83ef-0865817abc60 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:09.474647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d0800-e0e4-43d2-83ef-0865817abc60 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:09.476555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d0800-e0e4-43d2-83ef-0865817abc60 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:09.484530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 409/823] 10.222.0.48 () {56 vars in 1145 bytes} [Thu Jan 27 16:37:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:09.490085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdb28a-9e8c-4483-a291-0936f287abc8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:09.502775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdb28a-9e8c-4483-a291-0936f287abc8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:09.507963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d591ce3-647e-4fce-8636-12dea70a418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:09.508930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d591ce3-647e-4fce-8636-12dea70a418b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.509416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d591ce3-647e-4fce-8636-12dea70a418b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.509893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d591ce3-647e-4fce-8636-12dea70a418b admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.510880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d591ce3-647e-4fce-8636-12dea70a418b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:09.511398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d591ce3-647e-4fce-8636-12dea70a418b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:09.513837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d591ce3-647e-4fce-8636-12dea70a418b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:09.520900 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 415/824] 10.222.0.48 () {56 vars in 1145 bytes} [Thu Jan 27 16:37:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:09.528939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d0800-e0e4-43d2-83ef-0865817abc60 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:09.540453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d0800-e0e4-43d2-83ef-0865817abc60 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:09.554249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b2f4d-a973-4f68-9c7e-fa222ba8cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:09.554918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2f4d-a973-4f68-9c7e-fa222ba8cc57 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.555203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2f4d-a973-4f68-9c7e-fa222ba8cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.555481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b2f4d-a973-4f68-9c7e-fa222ba8cc57 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.556287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2f4d-a973-4f68-9c7e-fa222ba8cc57 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:09.557307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-8b8b2f4d-a973-4f68-9c7e-fa222ba8cc57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:09.557307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:37:09.557307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:37:09.558189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b2f4d-a973-4f68-9c7e-fa222ba8cc57 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:09.589634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 410/825] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jan 27 16:37:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:09.797454 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79ea6-8cab-48d2-adf3-b31ce3521c0d None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.798147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79ea6-8cab-48d2-adf3-b31ce3521c0d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.798641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79ea6-8cab-48d2-adf3-b31ce3521c0d None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.800692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 416/826] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:09.806266 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c52a1c-cb71-4af5-96bf-5682ba58dbfb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.806557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c52a1c-cb71-4af5-96bf-5682ba58dbfb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.807014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c52a1c-cb71-4af5-96bf-5682ba58dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.838390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e4c52a1c-cb71-4af5-96bf-5682ba58dbfb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:09.839612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e4c52a1c-cb71-4af5-96bf-5682ba58dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:09.865972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 411/827] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:09 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:09.889096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79ea6-8cab-48d2-adf3-b31ce3521c0d None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:09.906776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79ea6-8cab-48d2-adf3-b31ce3521c0d None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:09.911690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e2a3c-2f9a-4a93-9517-35adf9c4c457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:09.912520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2a3c-2f9a-4a93-9517-35adf9c4c457 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.912797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2a3c-2f9a-4a93-9517-35adf9c4c457 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.913068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e2a3c-2f9a-4a93-9517-35adf9c4c457 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.913743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e2a3c-2f9a-4a93-9517-35adf9c4c457 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:09.915377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e2a3c-2f9a-4a93-9517-35adf9c4c457 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:09.928280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-c62e2a3c-2f9a-4a93-9517-35adf9c4c457 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 27 16:37:09.929862 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 417/828] 10.222.0.48 () {56 vars in 1153 bytes} [Thu Jan 27 16:37:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:09.936775 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c52a1c-cb71-4af5-96bf-5682ba58dbfb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:09.950061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c52a1c-cb71-4af5-96bf-5682ba58dbfb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:09.956669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267cb40-60d4-4099-ac65-911f493b0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:09.957339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267cb40-60d4-4099-ac65-911f493b0f78 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.957630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267cb40-60d4-4099-ac65-911f493b0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.957901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267cb40-60d4-4099-ac65-911f493b0f78 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.958680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267cb40-60d4-4099-ac65-911f493b0f78 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:09.958995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267cb40-60d4-4099-ac65-911f493b0f78 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:09.961340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267cb40-60d4-4099-ac65-911f493b0f78 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:09.966565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 412/829] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:09.971949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e2a3c-2f9a-4a93-9517-35adf9c4c457 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:09.982249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e2a3c-2f9a-4a93-9517-35adf9c4c457 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:09.986636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5f756-88ea-4963-b36c-07e4d6dd4877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:09.987294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5f756-88ea-4963-b36c-07e4d6dd4877 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:09.987591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5f756-88ea-4963-b36c-07e4d6dd4877 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:09.988826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5f756-88ea-4963-b36c-07e4d6dd4877 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:09.989559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5f756-88ea-4963-b36c-07e4d6dd4877 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:09.989866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5f756-88ea-4963-b36c-07e4d6dd4877 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:09.991452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5f756-88ea-4963-b36c-07e4d6dd4877 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.004050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 418/830] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:10.206786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9d01-3eab-4e40-b85e-b635c0d5b6c4 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.207116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9d01-3eab-4e40-b85e-b635c0d5b6c4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.207292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9d01-3eab-4e40-b85e-b635c0d5b6c4 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.209374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 413/831] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:10.214981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2f39d-c58d-478d-bfee-7b693ab640dd None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.215268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2f39d-c58d-478d-bfee-7b693ab640dd None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.215530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2f39d-c58d-478d-bfee-7b693ab640dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.235603 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-20f2f39d-c58d-478d-bfee-7b693ab640dd None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:10.236935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-20f2f39d-c58d-478d-bfee-7b693ab640dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:10.244937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 419/832] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:10 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:10.270245 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b9d01-3eab-4e40-b85e-b635c0d5b6c4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.288545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b9d01-3eab-4e40-b85e-b635c0d5b6c4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.297800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f827-64e9-4c96-9c05-313c18b9ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.298605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f827-64e9-4c96-9c05-313c18b9ee99 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.298887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f827-64e9-4c96-9c05-313c18b9ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.299164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f827-64e9-4c96-9c05-313c18b9ee99 admin admin] PATH_INFO: `/v3/services/network` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.299854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16f827-64e9-4c96-9c05-313c18b9ee99 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.301450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16f827-64e9-4c96-9c05-313c18b9ee99 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.313972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-5e16f827-64e9-4c96-9c05-313c18b9ee99 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jan 27 16:37:10.315505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 414/833] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:10.321452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2f39d-c58d-478d-bfee-7b693ab640dd None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.336128 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2f39d-c58d-478d-bfee-7b693ab640dd None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.344979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea5754-4579-4ea6-990d-14313fb597f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.345661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea5754-4579-4ea6-990d-14313fb597f6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.345946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea5754-4579-4ea6-990d-14313fb597f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.346227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea5754-4579-4ea6-990d-14313fb597f6 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.346962 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea5754-4579-4ea6-990d-14313fb597f6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:10.347330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea5754-4579-4ea6-990d-14313fb597f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.348970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea5754-4579-4ea6-990d-14313fb597f6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.360149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 420/834] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:10.365803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f827-64e9-4c96-9c05-313c18b9ee99 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.380687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f827-64e9-4c96-9c05-313c18b9ee99 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.392425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d36c9d-f268-4937-a8ba-f124ee3cac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.393103 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36c9d-f268-4937-a8ba-f124ee3cac80 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.393385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36c9d-f268-4937-a8ba-f124ee3cac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.393662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36c9d-f268-4937-a8ba-f124ee3cac80 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.394380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d36c9d-f268-4937-a8ba-f124ee3cac80 admin admin] RBAC: Adding query filter params (type=network) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:10.394684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d36c9d-f268-4937-a8ba-f124ee3cac80 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.396301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d36c9d-f268-4937-a8ba-f124ee3cac80 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.401824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 415/835] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:10.408384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea5754-4579-4ea6-990d-14313fb597f6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.425457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea5754-4579-4ea6-990d-14313fb597f6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.432894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647360e-35b8-47b6-8b78-fe7994bdb6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.433583 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647360e-35b8-47b6-8b78-fe7994bdb6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.433868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647360e-35b8-47b6-8b78-fe7994bdb6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.434150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647360e-35b8-47b6-8b78-fe7994bdb6b8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.434926 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647360e-35b8-47b6-8b78-fe7994bdb6b8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.436223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-6647360e-35b8-47b6-8b78-fe7994bdb6b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:10.436223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:37:10.436223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:37:10.437182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647360e-35b8-47b6-8b78-fe7994bdb6b8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.442570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd50fd7-c504-4e41-9b6c-ce1d9d72a239 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.442570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd50fd7-c504-4e41-9b6c-ce1d9d72a239 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.442570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd50fd7-c504-4e41-9b6c-ce1d9d72a239 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.445194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 416/836] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:10.455897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5305-f683-48ba-b204-a4b35b98152a None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.456459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5305-f683-48ba-b204-a4b35b98152a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.456742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5305-f683-48ba-b204-a4b35b98152a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.467261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 421/837] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jan 27 16:37:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:10.488675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-64ac5305-f683-48ba-b204-a4b35b98152a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:10.490308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-64ac5305-f683-48ba-b204-a4b35b98152a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:10.514830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 417/838] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:10 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:10.556102 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647360e-35b8-47b6-8b78-fe7994bdb6b8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.569356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647360e-35b8-47b6-8b78-fe7994bdb6b8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.578792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b4441-1db5-4dba-91a2-0fe8e30e0dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.579998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b4441-1db5-4dba-91a2-0fe8e30e0dce admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.580518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b4441-1db5-4dba-91a2-0fe8e30e0dce admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.581059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b4441-1db5-4dba-91a2-0fe8e30e0dce admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.600562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b4441-1db5-4dba-91a2-0fe8e30e0dce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:10.608581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-d35b4441-1db5-4dba-91a2-0fe8e30e0dce admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:10.610175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 422/839] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:10.615963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5305-f683-48ba-b204-a4b35b98152a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.630196 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5305-f683-48ba-b204-a4b35b98152a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.637293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85965-e706-40f2-b744-6c02cf5e2475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.638457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85965-e706-40f2-b744-6c02cf5e2475 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.639450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85965-e706-40f2-b744-6c02cf5e2475 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.640017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e85965-e706-40f2-b744-6c02cf5e2475 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.641028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e85965-e706-40f2-b744-6c02cf5e2475 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:10.641546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e85965-e706-40f2-b744-6c02cf5e2475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.643399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e85965-e706-40f2-b744-6c02cf5e2475 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.655700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 418/840] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:10.661555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b4441-1db5-4dba-91a2-0fe8e30e0dce admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.673956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b4441-1db5-4dba-91a2-0fe8e30e0dce admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.680590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd929440-25f3-4064-9081-e3a48d4c0c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.681706 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd929440-25f3-4064-9081-e3a48d4c0c06 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.682263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd929440-25f3-4064-9081-e3a48d4c0c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.682745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd929440-25f3-4064-9081-e3a48d4c0c06 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.696771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd929440-25f3-4064-9081-e3a48d4c0c06 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.698857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd929440-25f3-4064-9081-e3a48d4c0c06 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.721515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-fd929440-25f3-4064-9081-e3a48d4c0c06 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:10.722643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 423/841] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:10.728212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85965-e706-40f2-b744-6c02cf5e2475 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.743322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e85965-e706-40f2-b744-6c02cf5e2475 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.750885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1376-105d-47f4-83b0-81a71feec3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.751886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1376-105d-47f4-83b0-81a71feec3ae admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.752429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1376-105d-47f4-83b0-81a71feec3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.752906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1376-105d-47f4-83b0-81a71feec3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.753888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d1376-105d-47f4-83b0-81a71feec3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:10.754395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d1376-105d-47f4-83b0-81a71feec3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.756321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d1376-105d-47f4-83b0-81a71feec3ae admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.770497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 419/842] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:10.775590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd929440-25f3-4064-9081-e3a48d4c0c06 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.787081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd929440-25f3-4064-9081-e3a48d4c0c06 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.793753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb517e3-2ba7-4b7d-a75d-732449261fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.794570 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb517e3-2ba7-4b7d-a75d-732449261fdb admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.795266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb517e3-2ba7-4b7d-a75d-732449261fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.795552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb517e3-2ba7-4b7d-a75d-732449261fdb admin admin] PATH_INFO: `/v3/users/swift` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.807981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb517e3-2ba7-4b7d-a75d-732449261fdb admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.809998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb517e3-2ba7-4b7d-a75d-732449261fdb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.832482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-ceb517e3-2ba7-4b7d-a75d-732449261fdb admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jan 27 16:37:10.833745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 424/843] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:10.839463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1376-105d-47f4-83b0-81a71feec3ae admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.853279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1376-105d-47f4-83b0-81a71feec3ae admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.862006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f255d-c73f-43f2-955c-849ab04c3275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.862685 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f255d-c73f-43f2-955c-849ab04c3275 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.862972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f255d-c73f-43f2-955c-849ab04c3275 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.863253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f255d-c73f-43f2-955c-849ab04c3275 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.864144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f255d-c73f-43f2-955c-849ab04c3275 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:10.864457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f255d-c73f-43f2-955c-849ab04c3275 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.866310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f255d-c73f-43f2-955c-849ab04c3275 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.886297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 420/844] 10.222.0.48 () {56 vars in 1156 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:10.892363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb517e3-2ba7-4b7d-a75d-732449261fdb admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.902369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb517e3-2ba7-4b7d-a75d-732449261fdb admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.907246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d0734-41b2-4406-b075-747b895e377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.908117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d0734-41b2-4406-b075-747b895e377f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.908540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d0734-41b2-4406-b075-747b895e377f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.908971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d0734-41b2-4406-b075-747b895e377f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.917636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d0734-41b2-4406-b075-747b895e377f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.919543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d0734-41b2-4406-b075-747b895e377f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.929654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 425/845] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:10.936123 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f255d-c73f-43f2-955c-849ab04c3275 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:10.946082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f255d-c73f-43f2-955c-849ab04c3275 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:10.951109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5bd5d-7113-4037-bb49-d1e4b3d03b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:10.952324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5bd5d-7113-4037-bb49-d1e4b3d03b63 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:10.952745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5bd5d-7113-4037-bb49-d1e4b3d03b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:10.953223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5bd5d-7113-4037-bb49-d1e4b3d03b63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:10.963921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5bd5d-7113-4037-bb49-d1e4b3d03b63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:10.965948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5bd5d-7113-4037-bb49-d1e4b3d03b63 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:10.984187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-e8b5bd5d-7113-4037-bb49-d1e4b3d03b63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:10.985896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 421/846] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:10.991521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d0734-41b2-4406-b075-747b895e377f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.001470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d0734-41b2-4406-b075-747b895e377f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.006161 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a453-2694-4f78-ace2-d348854c3189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.007062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a453-2694-4f78-ace2-d348854c3189 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.007484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a453-2694-4f78-ace2-d348854c3189 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.007941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809a453-2694-4f78-ace2-d348854c3189 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.008824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809a453-2694-4f78-ace2-d348854c3189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:11.009271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809a453-2694-4f78-ace2-d348854c3189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.011003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2809a453-2694-4f78-ace2-d348854c3189 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.024023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 426/847] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:11.030570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5bd5d-7113-4037-bb49-d1e4b3d03b63 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.041424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5bd5d-7113-4037-bb49-d1e4b3d03b63 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.046953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fdb22-4907-405c-88b0-f7295e6d3b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.048009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fdb22-4907-405c-88b0-f7295e6d3b54 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.048472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fdb22-4907-405c-88b0-f7295e6d3b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.048886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fdb22-4907-405c-88b0-f7295e6d3b54 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.056477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fdb22-4907-405c-88b0-f7295e6d3b54 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.058699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fdb22-4907-405c-88b0-f7295e6d3b54 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.073185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-df9fdb22-4907-405c-88b0-f7295e6d3b54 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:11.074925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 422/848] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:11.080941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a453-2694-4f78-ace2-d348854c3189 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.091169 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809a453-2694-4f78-ace2-d348854c3189 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.096130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e84ab-c565-4f8d-9e31-aacfd1ddbc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.096967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e84ab-c565-4f8d-9e31-aacfd1ddbc13 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.097439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e84ab-c565-4f8d-9e31-aacfd1ddbc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.097853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e84ab-c565-4f8d-9e31-aacfd1ddbc13 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.098848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e84ab-c565-4f8d-9e31-aacfd1ddbc13 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:11.099308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e84ab-c565-4f8d-9e31-aacfd1ddbc13 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.101421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e84ab-c565-4f8d-9e31-aacfd1ddbc13 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.115111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 427/849] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:11.120916 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fdb22-4907-405c-88b0-f7295e6d3b54 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.132190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fdb22-4907-405c-88b0-f7295e6d3b54 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.137067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d38bde8-3752-46ea-b63f-52bd674feda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.137830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38bde8-3752-46ea-b63f-52bd674feda1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.138251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38bde8-3752-46ea-b63f-52bd674feda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.139126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38bde8-3752-46ea-b63f-52bd674feda1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.140198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38bde8-3752-46ea-b63f-52bd674feda1 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=e14c278fc5654bb9ae7c05d4ba023262) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:11.140661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38bde8-3752-46ea-b63f-52bd674feda1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.142655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d38bde8-3752-46ea-b63f-52bd674feda1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.149316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 423/850] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/role_assignments?user.id=e14c278fc5654bb9ae7c05d4ba023262&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:11.590486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d452-ac1d-4066-bf4a-ddb47bbffcb8 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.590978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d452-ac1d-4066-bf4a-ddb47bbffcb8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.591092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2d452-ac1d-4066-bf4a-ddb47bbffcb8 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.593741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 428/851] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:11.598994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d031-e682-4060-ab8f-a59eacd1d3d8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.599398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d031-e682-4060-ab8f-a59eacd1d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.599560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38d031-e682-4060-ab8f-a59eacd1d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.618195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9e38d031-e682-4060-ab8f-a59eacd1d3d8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:11.619379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9e38d031-e682-4060-ab8f-a59eacd1d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:11.627963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 424/852] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:11 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:11.652175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2d452-ac1d-4066-bf4a-ddb47bbffcb8 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.665601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2d452-ac1d-4066-bf4a-ddb47bbffcb8 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.670865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4b37b-3ab1-4316-b845-e8da7cef7f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.671680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4b37b-3ab1-4316-b845-e8da7cef7f4b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.671965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4b37b-3ab1-4316-b845-e8da7cef7f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.672242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4b37b-3ab1-4316-b845-e8da7cef7f4b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.682628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4b37b-3ab1-4316-b845-e8da7cef7f4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:11.689833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-5bd4b37b-3ab1-4316-b845-e8da7cef7f4b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:37:11.691318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 429/853] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:11.697059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d031-e682-4060-ab8f-a59eacd1d3d8 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.706984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38d031-e682-4060-ab8f-a59eacd1d3d8 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.711539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cbaa6-4016-47c2-bb46-6b50f2eda3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.712224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbaa6-4016-47c2-bb46-6b50f2eda3db admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.712511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbaa6-4016-47c2-bb46-6b50f2eda3db admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.712789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbaa6-4016-47c2-bb46-6b50f2eda3db admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.713547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cbaa6-4016-47c2-bb46-6b50f2eda3db admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:11.713855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cbaa6-4016-47c2-bb46-6b50f2eda3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.715598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cbaa6-4016-47c2-bb46-6b50f2eda3db admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.725031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 425/854] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:11.730335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4b37b-3ab1-4316-b845-e8da7cef7f4b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.740425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4b37b-3ab1-4316-b845-e8da7cef7f4b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.745000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016bdc3-e73d-435e-a399-059c394e2065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.745780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016bdc3-e73d-435e-a399-059c394e2065 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.746065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016bdc3-e73d-435e-a399-059c394e2065 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.746351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016bdc3-e73d-435e-a399-059c394e2065 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.757626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016bdc3-e73d-435e-a399-059c394e2065 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.759459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016bdc3-e73d-435e-a399-059c394e2065 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.776513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-8016bdc3-e73d-435e-a399-059c394e2065 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:11.777990 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 430/855] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:11.784500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cbaa6-4016-47c2-bb46-6b50f2eda3db admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.794463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cbaa6-4016-47c2-bb46-6b50f2eda3db admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.799879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01805df-75e7-4d49-bd79-0921d78c786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.800483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01805df-75e7-4d49-bd79-0921d78c786c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.800772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01805df-75e7-4d49-bd79-0921d78c786c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.801049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01805df-75e7-4d49-bd79-0921d78c786c admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.801793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01805df-75e7-4d49-bd79-0921d78c786c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:11.802102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01805df-75e7-4d49-bd79-0921d78c786c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.803720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01805df-75e7-4d49-bd79-0921d78c786c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.817097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 426/856] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:11.822453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016bdc3-e73d-435e-a399-059c394e2065 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.833881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016bdc3-e73d-435e-a399-059c394e2065 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.839014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b9a51-04a4-4a9e-ad6f-09585af65b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.840031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b9a51-04a4-4a9e-ad6f-09585af65b6c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.840324 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b9a51-04a4-4a9e-ad6f-09585af65b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.840605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b9a51-04a4-4a9e-ad6f-09585af65b6c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.852254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b9a51-04a4-4a9e-ad6f-09585af65b6c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.854566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b9a51-04a4-4a9e-ad6f-09585af65b6c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.869557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-986b9a51-04a4-4a9e-ad6f-09585af65b6c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 27 16:37:11.871290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 431/857] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:11.877452 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01805df-75e7-4d49-bd79-0921d78c786c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.887405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01805df-75e7-4d49-bd79-0921d78c786c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.892172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a89c0-9836-4fb4-8a57-d4bbb6ecf4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.892838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a89c0-9836-4fb4-8a57-d4bbb6ecf4cf admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.893132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a89c0-9836-4fb4-8a57-d4bbb6ecf4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.893412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a89c0-9836-4fb4-8a57-d4bbb6ecf4cf admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.894260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a89c0-9836-4fb4-8a57-d4bbb6ecf4cf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:11.894573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a89c0-9836-4fb4-8a57-d4bbb6ecf4cf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.896462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a89c0-9836-4fb4-8a57-d4bbb6ecf4cf admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.914728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 427/858] 10.222.0.48 () {56 vars in 1170 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:11.920980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b9a51-04a4-4a9e-ad6f-09585af65b6c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.930855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b9a51-04a4-4a9e-ad6f-09585af65b6c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.936182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb0c1f-e571-4050-80d3-a270fad8fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.936919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb0c1f-e571-4050-80d3-a270fad8fea0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.937209 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb0c1f-e571-4050-80d3-a270fad8fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.937491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb0c1f-e571-4050-80d3-a270fad8fea0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.945782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb0c1f-e571-4050-80d3-a270fad8fea0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.947544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb0c1f-e571-4050-80d3-a270fad8fea0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:11.957493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 432/859] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:11.963206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a89c0-9836-4fb4-8a57-d4bbb6ecf4cf admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:11.973243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a89c0-9836-4fb4-8a57-d4bbb6ecf4cf admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:11.977873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3bb7-3251-4732-8ed9-971e7846de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:11.978662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3bb7-3251-4732-8ed9-971e7846de3e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:11.978953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3bb7-3251-4732-8ed9-971e7846de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:11.979338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3bb7-3251-4732-8ed9-971e7846de3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:11.990802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b3bb7-3251-4732-8ed9-971e7846de3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:11.992699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b3bb7-3251-4732-8ed9-971e7846de3e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:12.010974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-a96b3bb7-3251-4732-8ed9-971e7846de3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:12.012501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 428/860] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:12.018749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb0c1f-e571-4050-80d3-a270fad8fea0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:12.028232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb0c1f-e571-4050-80d3-a270fad8fea0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:12.033626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e6bd-533f-44fc-8c8d-5605052f661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:12.034600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e6bd-533f-44fc-8c8d-5605052f661e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.034889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e6bd-533f-44fc-8c8d-5605052f661e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.035169 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e6bd-533f-44fc-8c8d-5605052f661e admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.035948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32e6bd-533f-44fc-8c8d-5605052f661e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:12.036259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32e6bd-533f-44fc-8c8d-5605052f661e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:12.037858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32e6bd-533f-44fc-8c8d-5605052f661e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:12.051867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 433/861] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:12.056990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3bb7-3251-4732-8ed9-971e7846de3e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:12.067915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3bb7-3251-4732-8ed9-971e7846de3e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:12.072538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ecdc1-7bc4-42dd-9362-e91721712d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:12.073299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ecdc1-7bc4-42dd-9362-e91721712d6d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.073615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ecdc1-7bc4-42dd-9362-e91721712d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.073866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ecdc1-7bc4-42dd-9362-e91721712d6d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.081816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ecdc1-7bc4-42dd-9362-e91721712d6d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:12.083818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ecdc1-7bc4-42dd-9362-e91721712d6d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:12.097206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-896ecdc1-7bc4-42dd-9362-e91721712d6d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:12.098721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 429/862] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:12.104352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e6bd-533f-44fc-8c8d-5605052f661e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:12.114376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e6bd-533f-44fc-8c8d-5605052f661e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:12.118980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8b7c1e-b61d-4798-bb97-c7047fff9445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:12.119661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b7c1e-b61d-4798-bb97-c7047fff9445 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.120067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b7c1e-b61d-4798-bb97-c7047fff9445 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.120455 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b7c1e-b61d-4798-bb97-c7047fff9445 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.121270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b7c1e-b61d-4798-bb97-c7047fff9445 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:12.121579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b7c1e-b61d-4798-bb97-c7047fff9445 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:12.124258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8b7c1e-b61d-4798-bb97-c7047fff9445 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:12.136758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 434/863] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:12.143429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ecdc1-7bc4-42dd-9362-e91721712d6d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:12.154521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ecdc1-7bc4-42dd-9362-e91721712d6d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:12.159906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ad8905-1737-42cb-abba-f4712f8125f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:12.160557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8905-1737-42cb-abba-f4712f8125f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.160895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8905-1737-42cb-abba-f4712f8125f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.161181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad8905-1737-42cb-abba-f4712f8125f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.162233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad8905-1737-42cb-abba-f4712f8125f4 admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=531ce85d5104400fa5adec42d30f399b) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:12.162554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad8905-1737-42cb-abba-f4712f8125f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:12.164502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ad8905-1737-42cb-abba-f4712f8125f4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:12.171598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 430/864] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:12 2022] GET /identity/v3/role_assignments?user.id=531ce85d5104400fa5adec42d30f399b&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:12.497532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a786fd-98d3-4585-a02e-74a166b9c00d None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.497532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a786fd-98d3-4585-a02e-74a166b9c00d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.497532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a786fd-98d3-4585-a02e-74a166b9c00d None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.500280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 435/865] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:12.503853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399566e5-d475-42c3-8056-3ab5e7d2a6bb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.504152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399566e5-d475-42c3-8056-3ab5e7d2a6bb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.504434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399566e5-d475-42c3-8056-3ab5e7d2a6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.523192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-399566e5-d475-42c3-8056-3ab5e7d2a6bb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:12.524794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-399566e5-d475-42c3-8056-3ab5e7d2a6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:12.525356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15097e4-d4df-46bc-bd7d-c9e056fac7ee None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.525643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15097e4-d4df-46bc-bd7d-c9e056fac7ee None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.525918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15097e4-d4df-46bc-bd7d-c9e056fac7ee None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.527815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 436/866] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:12.533723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69829-8112-41d1-b7a8-8c92a436746b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.534005 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69829-8112-41d1-b7a8-8c92a436746b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.534545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e69829-8112-41d1-b7a8-8c92a436746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.534756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 431/867] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:12 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:12.557844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399566e5-d475-42c3-8056-3ab5e7d2a6bb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:12.561367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-22e69829-8112-41d1-b7a8-8c92a436746b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:12.562556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-22e69829-8112-41d1-b7a8-8c92a436746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:12.567973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399566e5-d475-42c3-8056-3ab5e7d2a6bb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:12.571097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 437/868] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:12 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:12.576992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4324-6122-4b3a-9782-de3901581951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:12.577992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4324-6122-4b3a-9782-de3901581951 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.578442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4324-6122-4b3a-9782-de3901581951 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.578865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4324-6122-4b3a-9782-de3901581951 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.579715 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4324-6122-4b3a-9782-de3901581951 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:12.581478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4324-6122-4b3a-9782-de3901581951 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:12.593884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-12bd4324-6122-4b3a-9782-de3901581951 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 27 16:37:12.594942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69829-8112-41d1-b7a8-8c92a436746b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:12.596055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 432/869] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:37:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:12.601898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4324-6122-4b3a-9782-de3901581951 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:12.604389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e69829-8112-41d1-b7a8-8c92a436746b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:12.609316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6ccd9-287d-4aea-86c9-487ab5b65d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:12.609987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ccd9-287d-4aea-86c9-487ab5b65d9d admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.610643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ccd9-287d-4aea-86c9-487ab5b65d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.610643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6ccd9-287d-4aea-86c9-487ab5b65d9d admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.611248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6ccd9-287d-4aea-86c9-487ab5b65d9d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:12.612869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6ccd9-287d-4aea-86c9-487ab5b65d9d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:12.614701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4324-6122-4b3a-9782-de3901581951 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:12.620771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c23f-5ca2-4694-8cec-2c74d7788ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:12.621820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c23f-5ca2-4694-8cec-2c74d7788ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.622278 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c23f-5ca2-4694-8cec-2c74d7788ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.622702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c23f-5ca2-4694-8cec-2c74d7788ea7 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.623731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c23f-5ca2-4694-8cec-2c74d7788ea7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:12.624189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c23f-5ca2-4694-8cec-2c74d7788ea7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:12.626057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c23f-5ca2-4694-8cec-2c74d7788ea7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:12.627795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 438/870] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:37:12 2022] POST /identity/v3/services => generated 269 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:37:12.636242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 433/871] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:37:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:12.637279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6ccd9-287d-4aea-86c9-487ab5b65d9d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:12.668008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6ccd9-287d-4aea-86c9-487ab5b65d9d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:12.680577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965ec93-9e58-4820-9743-59907cbd6db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:12.681674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965ec93-9e58-4820-9743-59907cbd6db8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:12.682144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965ec93-9e58-4820-9743-59907cbd6db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:12.682645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965ec93-9e58-4820-9743-59907cbd6db8 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:12.683661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965ec93-9e58-4820-9743-59907cbd6db8 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:12.684196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965ec93-9e58-4820-9743-59907cbd6db8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:12.686203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965ec93-9e58-4820-9743-59907cbd6db8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:12.692541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 439/872] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:37:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:13.475347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf9e61-1ef0-4914-9ca3-13123d41dc9a None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:13.475777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf9e61-1ef0-4914-9ca3-13123d41dc9a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:13.475956 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf9e61-1ef0-4914-9ca3-13123d41dc9a None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:13.477939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 434/873] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:13.483675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a49a-9242-40c0-ba0e-85d2b592d454 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:13.483964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a49a-9242-40c0-ba0e-85d2b592d454 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:13.484246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3a49a-9242-40c0-ba0e-85d2b592d454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:13.502817 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-1bf3a49a-9242-40c0-ba0e-85d2b592d454 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:13.504379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-1bf3a49a-9242-40c0-ba0e-85d2b592d454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:13.515226 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 440/874] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:13 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:13.538343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf9e61-1ef0-4914-9ca3-13123d41dc9a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:13.556035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf9e61-1ef0-4914-9ca3-13123d41dc9a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:13.561300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f45a67-3da3-4dc9-932c-531300d724b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:13.562349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f45a67-3da3-4dc9-932c-531300d724b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:13.562844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f45a67-3da3-4dc9-932c-531300d724b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:13.563318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f45a67-3da3-4dc9-932c-531300d724b1 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:13.564207 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f45a67-3da3-4dc9-932c-531300d724b1 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:13.565994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f45a67-3da3-4dc9-932c-531300d724b1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:13.577974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-d7f45a67-3da3-4dc9-932c-531300d724b1 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 27 16:37:13.579691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 435/875] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:13.585772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a49a-9242-40c0-ba0e-85d2b592d454 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:13.595473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3a49a-9242-40c0-ba0e-85d2b592d454 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:13.600090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2e297-1924-4dbc-aea3-f8e05b133fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:13.600754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2e297-1924-4dbc-aea3-f8e05b133fdf admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:13.601040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2e297-1924-4dbc-aea3-f8e05b133fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:13.601320 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2e297-1924-4dbc-aea3-f8e05b133fdf admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:13.602046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2e297-1924-4dbc-aea3-f8e05b133fdf admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:13.602354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2e297-1924-4dbc-aea3-f8e05b133fdf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:13.603977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2e297-1924-4dbc-aea3-f8e05b133fdf admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:13.609270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 441/876] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:13.614594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f45a67-3da3-4dc9-932c-531300d724b1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:13.625337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f45a67-3da3-4dc9-932c-531300d724b1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:13.630122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34499b95-29da-406e-9c1a-0ebbe715fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:13.631014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34499b95-29da-406e-9c1a-0ebbe715fe88 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:13.631494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34499b95-29da-406e-9c1a-0ebbe715fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:13.632009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34499b95-29da-406e-9c1a-0ebbe715fe88 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:13.632935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34499b95-29da-406e-9c1a-0ebbe715fe88 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:13.633439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34499b95-29da-406e-9c1a-0ebbe715fe88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:13.635229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34499b95-29da-406e-9c1a-0ebbe715fe88 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:13.640850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 436/877] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:14.516783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162f8c5-6d58-4148-9ff2-6a4da22058be None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.517155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162f8c5-6d58-4148-9ff2-6a4da22058be None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.517330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1162f8c5-6d58-4148-9ff2-6a4da22058be None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.519371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 442/878] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:14.524665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52c185-39f4-42c4-a7b2-1b86c6daccbb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.524953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52c185-39f4-42c4-a7b2-1b86c6daccbb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.525231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52c185-39f4-42c4-a7b2-1b86c6daccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.546129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2d52c185-39f4-42c4-a7b2-1b86c6daccbb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:14.547367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2d52c185-39f4-42c4-a7b2-1b86c6daccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:14.555352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 437/879] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:14 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:14.580293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162f8c5-6d58-4148-9ff2-6a4da22058be None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.592459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1162f8c5-6d58-4148-9ff2-6a4da22058be None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.596888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc611e-51d4-4e32-a238-91a17b659e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.597686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc611e-51d4-4e32-a238-91a17b659e2f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.597968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc611e-51d4-4e32-a238-91a17b659e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.598245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc611e-51d4-4e32-a238-91a17b659e2f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.609154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc611e-51d4-4e32-a238-91a17b659e2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:14.616452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-8fdc611e-51d4-4e32-a238-91a17b659e2f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 27 16:37:14.617946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 443/880] 10.222.0.48 () {56 vars in 1141 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:14.624168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52c185-39f4-42c4-a7b2-1b86c6daccbb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.633093 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52c185-39f4-42c4-a7b2-1b86c6daccbb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.637652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40ca7-3887-4320-a6d0-3ba8a440c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.638381 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40ca7-3887-4320-a6d0-3ba8a440c049 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.638766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40ca7-3887-4320-a6d0-3ba8a440c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.639041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40ca7-3887-4320-a6d0-3ba8a440c049 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.640026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de40ca7-3887-4320-a6d0-3ba8a440c049 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:14.640332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de40ca7-3887-4320-a6d0-3ba8a440c049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:14.641919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de40ca7-3887-4320-a6d0-3ba8a440c049 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:14.650662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 438/881] 10.222.0.48 () {56 vars in 1136 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:14.656927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc611e-51d4-4e32-a238-91a17b659e2f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.666778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc611e-51d4-4e32-a238-91a17b659e2f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.671950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02f386-0457-47a0-a0c8-9163448953a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.672724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02f386-0457-47a0-a0c8-9163448953a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.673004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02f386-0457-47a0-a0c8-9163448953a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.673276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02f386-0457-47a0-a0c8-9163448953a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.684162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02f386-0457-47a0-a0c8-9163448953a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:14.686005 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02f386-0457-47a0-a0c8-9163448953a2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:14.703330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-6b02f386-0457-47a0-a0c8-9163448953a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:14.704982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 444/882] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:14.710800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40ca7-3887-4320-a6d0-3ba8a440c049 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.721916 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40ca7-3887-4320-a6d0-3ba8a440c049 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.726928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d848948-f2c3-4405-ad78-612ecbe4a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.727700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d848948-f2c3-4405-ad78-612ecbe4a06e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.727984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d848948-f2c3-4405-ad78-612ecbe4a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.728267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d848948-f2c3-4405-ad78-612ecbe4a06e admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.729113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d848948-f2c3-4405-ad78-612ecbe4a06e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:14.729419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d848948-f2c3-4405-ad78-612ecbe4a06e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:14.731122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d848948-f2c3-4405-ad78-612ecbe4a06e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:14.745056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 439/883] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:14.751016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02f386-0457-47a0-a0c8-9163448953a2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.760983 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02f386-0457-47a0-a0c8-9163448953a2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.765769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1876d-d4c3-4199-aaca-9de668a665fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.766605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1876d-d4c3-4199-aaca-9de668a665fb admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.766944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1876d-d4c3-4199-aaca-9de668a665fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.767166 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1876d-d4c3-4199-aaca-9de668a665fb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.776183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1876d-d4c3-4199-aaca-9de668a665fb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:14.778254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1876d-d4c3-4199-aaca-9de668a665fb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:14.793882 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-3ef1876d-d4c3-4199-aaca-9de668a665fb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 27 16:37:14.795986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 445/884] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:14.801611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d848948-f2c3-4405-ad78-612ecbe4a06e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.812346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d848948-f2c3-4405-ad78-612ecbe4a06e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.816994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeddbc1-1235-4fae-ad9d-869b97c0a7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.817656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeddbc1-1235-4fae-ad9d-869b97c0a7bb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.817983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeddbc1-1235-4fae-ad9d-869b97c0a7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.818259 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeddbc1-1235-4fae-ad9d-869b97c0a7bb admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.819153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeddbc1-1235-4fae-ad9d-869b97c0a7bb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:14.819465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeddbc1-1235-4fae-ad9d-869b97c0a7bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:14.821406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeddbc1-1235-4fae-ad9d-869b97c0a7bb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:14.840614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 440/885] 10.222.0.48 () {56 vars in 1170 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:14.846209 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1876d-d4c3-4199-aaca-9de668a665fb admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.856246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1876d-d4c3-4199-aaca-9de668a665fb admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.861427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23235d02-a990-43b4-a5a0-b9224f70ac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.862167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235d02-a990-43b4-a5a0-b9224f70ac21 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.862449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235d02-a990-43b4-a5a0-b9224f70ac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.862724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23235d02-a990-43b4-a5a0-b9224f70ac21 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.871122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23235d02-a990-43b4-a5a0-b9224f70ac21 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:14.873673 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23235d02-a990-43b4-a5a0-b9224f70ac21 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:14.883448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 446/886] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:14.889281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeddbc1-1235-4fae-ad9d-869b97c0a7bb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.899349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeddbc1-1235-4fae-ad9d-869b97c0a7bb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.903977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25317962-a7e9-4d23-8fe1-09f009657ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.904795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317962-a7e9-4d23-8fe1-09f009657ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.905105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317962-a7e9-4d23-8fe1-09f009657ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.905445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25317962-a7e9-4d23-8fe1-09f009657ae9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.916082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25317962-a7e9-4d23-8fe1-09f009657ae9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:14.917922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25317962-a7e9-4d23-8fe1-09f009657ae9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:14.936072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-25317962-a7e9-4d23-8fe1-09f009657ae9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:14.937577 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 441/887] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:14.942741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23235d02-a990-43b4-a5a0-b9224f70ac21 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.952063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23235d02-a990-43b4-a5a0-b9224f70ac21 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.956650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119f726-10a3-46d1-b62c-a5e93eacac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.957301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119f726-10a3-46d1-b62c-a5e93eacac75 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.957581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119f726-10a3-46d1-b62c-a5e93eacac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.957856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119f726-10a3-46d1-b62c-a5e93eacac75 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.958587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119f726-10a3-46d1-b62c-a5e93eacac75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:14.958891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119f726-10a3-46d1-b62c-a5e93eacac75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:14.960498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119f726-10a3-46d1-b62c-a5e93eacac75 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:14.968887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56e1e-9485-4ab0-9936-40f46e1720a5 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.969176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56e1e-9485-4ab0-9936-40f46e1720a5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.969455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff56e1e-9485-4ab0-9936-40f46e1720a5 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.972542 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 442/888] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:14.973165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 447/889] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:14.978347 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119f726-10a3-46d1-b62c-a5e93eacac75 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:14.978638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359f6be-1125-4527-8455-863488fe29f2 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.978967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359f6be-1125-4527-8455-863488fe29f2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.979248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359f6be-1125-4527-8455-863488fe29f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.988731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119f726-10a3-46d1-b62c-a5e93eacac75 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:14.993489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78fb39-1af5-402b-88a7-981f1f41d98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:14.994313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78fb39-1af5-402b-88a7-981f1f41d98a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:14.994591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78fb39-1af5-402b-88a7-981f1f41d98a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:14.994865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78fb39-1af5-402b-88a7-981f1f41d98a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:14.997549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e359f6be-1125-4527-8455-863488fe29f2 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:14.999556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e359f6be-1125-4527-8455-863488fe29f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:15.003260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78fb39-1af5-402b-88a7-981f1f41d98a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:15.005682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78fb39-1af5-402b-88a7-981f1f41d98a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:15.007215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 443/890] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:14 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:15.020292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-be78fb39-1af5-402b-88a7-981f1f41d98a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:15.021768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 448/891] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:15.027324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359f6be-1125-4527-8455-863488fe29f2 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:15.032349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78fb39-1af5-402b-88a7-981f1f41d98a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:15.037959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359f6be-1125-4527-8455-863488fe29f2 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:15.045926 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78fb39-1af5-402b-88a7-981f1f41d98a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:15.046793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36280416-9ece-4ec2-be65-edb19a499931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:15.047691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280416-9ece-4ec2-be65-edb19a499931 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.048144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280416-9ece-4ec2-be65-edb19a499931 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.048598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36280416-9ece-4ec2-be65-edb19a499931 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.049788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280416-9ece-4ec2-be65-edb19a499931 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:15.050270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280416-9ece-4ec2-be65-edb19a499931 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:15.050762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12494-32f8-4cef-adb4-8466aa70a28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:15.051619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12494-32f8-4cef-adb4-8466aa70a28e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.051910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12494-32f8-4cef-adb4-8466aa70a28e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.052186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c12494-32f8-4cef-adb4-8466aa70a28e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.052825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36280416-9ece-4ec2-be65-edb19a499931 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:15.052987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12494-32f8-4cef-adb4-8466aa70a28e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:15.054428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c12494-32f8-4cef-adb4-8466aa70a28e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:15.066231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 444/892] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:15.066384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-29c12494-32f8-4cef-adb4-8466aa70a28e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 27 16:37:15.071220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 449/893] 10.222.0.48 () {56 vars in 1153 bytes} [Thu Jan 27 16:37:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:15.071388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72e31-b400-41bd-9de2-a0acb804c474 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.071689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72e31-b400-41bd-9de2-a0acb804c474 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.071973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d72e31-b400-41bd-9de2-a0acb804c474 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.072158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12494-32f8-4cef-adb4-8466aa70a28e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:15.074132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 445/894] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:15.074776 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d72e31-b400-41bd-9de2-a0acb804c474 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:15.082905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c12494-32f8-4cef-adb4-8466aa70a28e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:15.087489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e05a016-2e88-4386-a885-006ef720367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:15.088153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a016-2e88-4386-a885-006ef720367b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.088256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d72e31-b400-41bd-9de2-a0acb804c474 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:15.088438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a016-2e88-4386-a885-006ef720367b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.088707 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e05a016-2e88-4386-a885-006ef720367b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.089536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05a016-2e88-4386-a885-006ef720367b admin admin] RBAC: Adding query filter params (role.id=6dc9a8ecd98b4fab8314890bf5b2bad9, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=531ce85d5104400fa5adec42d30f399b) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:15.089844 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05a016-2e88-4386-a885-006ef720367b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:15.092259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e05a016-2e88-4386-a885-006ef720367b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:15.093669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8e4a-9703-48a7-b6b3-399b2f6e54c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:15.094443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8e4a-9703-48a7-b6b3-399b2f6e54c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.094764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8e4a-9703-48a7-b6b3-399b2f6e54c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.095047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8e4a-9703-48a7-b6b3-399b2f6e54c0 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.095799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b8e4a-9703-48a7-b6b3-399b2f6e54c0 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:15.096110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b8e4a-9703-48a7-b6b3-399b2f6e54c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:15.097702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b8e4a-9703-48a7-b6b3-399b2f6e54c0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:15.099783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 450/895] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:15 2022] GET /identity/v3/role_assignments?user.id=531ce85d5104400fa5adec42d30f399b&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=6dc9a8ecd98b4fab8314890bf5b2bad9 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:15.100453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16fb1e-6142-45db-b172-46c3816005c3 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.100768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16fb1e-6142-45db-b172-46c3816005c3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.101023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16fb1e-6142-45db-b172-46c3816005c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.104328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 446/896] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:15.111084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8e4a-9703-48a7-b6b3-399b2f6e54c0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:15.121703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-9c16fb1e-6142-45db-b172-46c3816005c3 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:15.122645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8e4a-9703-48a7-b6b3-399b2f6e54c0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:15.123346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9c16fb1e-6142-45db-b172-46c3816005c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:15.128022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1d314-363a-469d-b7a2-4276190fb145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:15.129030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d314-363a-469d-b7a2-4276190fb145 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.129476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d314-363a-469d-b7a2-4276190fb145 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.129898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1d314-363a-469d-b7a2-4276190fb145 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.130975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1d314-363a-469d-b7a2-4276190fb145 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:15.131434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1d314-363a-469d-b7a2-4276190fb145 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:15.132794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 451/897] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:15 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:15.133585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1d314-363a-469d-b7a2-4276190fb145 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:15.144323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 447/898] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:15.149702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16fb1e-6142-45db-b172-46c3816005c3 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:15.159730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1d314-363a-469d-b7a2-4276190fb145 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:15.160973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16fb1e-6142-45db-b172-46c3816005c3 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:15.165723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:15.166400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.166686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.166971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.167830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] RBAC: Adding query filter params (interface=public, service_id=3adbf5c55c6f4e0f82aff3fcdf242e75, region_id=RegionOne) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:15.168145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:15.169194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:15.169194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:37:15.169194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:37:15.170998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:15.172333 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1d314-363a-469d-b7a2-4276190fb145 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:15.178446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e75c9-cc36-4ef7-8c2d-7ac5da76b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:15.179126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e75c9-cc36-4ef7-8c2d-7ac5da76b267 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.179460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e75c9-cc36-4ef7-8c2d-7ac5da76b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.179777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 452/899] 10.222.0.48 () {56 vars in 1272 bytes} [Thu Jan 27 16:37:15 2022] GET /identity/v3/endpoints?service_id=3adbf5c55c6f4e0f82aff3fcdf242e75&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:15.179890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e75c9-cc36-4ef7-8c2d-7ac5da76b267 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.180785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e75c9-cc36-4ef7-8c2d-7ac5da76b267 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:15.181888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-959e75c9-cc36-4ef7-8c2d-7ac5da76b267 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:15.181888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:37:15.181888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:37:15.182879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e75c9-cc36-4ef7-8c2d-7ac5da76b267 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:15.185154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:15.196994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0df647-565b-4320-9a7a-210be13f636f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:15.203689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 448/900] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:37:15 2022] POST /identity/v3/services => generated 251 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:37:15.225440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bb246-a36e-40bc-9157-22f9bda25b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:15.226538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bb246-a36e-40bc-9157-22f9bda25b28 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.227068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bb246-a36e-40bc-9157-22f9bda25b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.227676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bb246-a36e-40bc-9157-22f9bda25b28 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.228613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bb246-a36e-40bc-9157-22f9bda25b28 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:15.230545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bb246-a36e-40bc-9157-22f9bda25b28 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:15.238629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 453/901] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:37:15 2022] GET /identity/v3/services => generated 1268 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:37:15.955219 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849ecf9-f06a-4945-90c0-951ba5d025e1 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.955726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849ecf9-f06a-4945-90c0-951ba5d025e1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.955726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849ecf9-f06a-4945-90c0-951ba5d025e1 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.957707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 449/902] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:15.963193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073c052-d445-4df1-b6a9-f31a56e9d8f6 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:15.963626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073c052-d445-4df1-b6a9-f31a56e9d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:15.963795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073c052-d445-4df1-b6a9-f31a56e9d8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:15.983388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2073c052-d445-4df1-b6a9-f31a56e9d8f6 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:15.984664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2073c052-d445-4df1-b6a9-f31a56e9d8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:15.992658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 454/903] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:15 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:16.015333 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849ecf9-f06a-4945-90c0-951ba5d025e1 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:16.027677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849ecf9-f06a-4945-90c0-951ba5d025e1 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:16.032780 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21841195-d4ae-450e-a4ba-57e20b8705ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:16.033439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21841195-d4ae-450e-a4ba-57e20b8705ca admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:16.033724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21841195-d4ae-450e-a4ba-57e20b8705ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:16.034005 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21841195-d4ae-450e-a4ba-57e20b8705ca admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:16.035026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21841195-d4ae-450e-a4ba-57e20b8705ca admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:16.036656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21841195-d4ae-450e-a4ba-57e20b8705ca admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:16.052656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 450/904] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:37:16 2022] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:17.387066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d3d7a-385b-456b-be93-c8d9b93c2d88 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.387610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d3d7a-385b-456b-be93-c8d9b93c2d88 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.387819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d3d7a-385b-456b-be93-c8d9b93c2d88 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.390056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 455/905] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:17.395319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af561d-67f3-4a79-a66f-e87b4ae6a1de None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.395807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af561d-67f3-4a79-a66f-e87b4ae6a1de None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.395891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af561d-67f3-4a79-a66f-e87b4ae6a1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.414705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d1af561d-67f3-4a79-a66f-e87b4ae6a1de None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:17.415987 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d1af561d-67f3-4a79-a66f-e87b4ae6a1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:17.433089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 451/906] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:17 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:17.456961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d3d7a-385b-456b-be93-c8d9b93c2d88 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.470141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d3d7a-385b-456b-be93-c8d9b93c2d88 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.474750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bae20-df02-4817-b9e1-6302d5a4ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.475792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bae20-df02-4817-b9e1-6302d5a4ba0f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.476290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bae20-df02-4817-b9e1-6302d5a4ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.476775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bae20-df02-4817-b9e1-6302d5a4ba0f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.488426 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bae20-df02-4817-b9e1-6302d5a4ba0f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:17.496584 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-644bae20-df02-4817-b9e1-6302d5a4ba0f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 27 16:37:17.498331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 456/907] 10.222.0.48 () {56 vars in 1141 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:17.504584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af561d-67f3-4a79-a66f-e87b4ae6a1de None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.513709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af561d-67f3-4a79-a66f-e87b4ae6a1de None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.518361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cf8b2-067a-4f27-b32c-02079a7fec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.519022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cf8b2-067a-4f27-b32c-02079a7fec73 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.519307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cf8b2-067a-4f27-b32c-02079a7fec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.519604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cf8b2-067a-4f27-b32c-02079a7fec73 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.520385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cf8b2-067a-4f27-b32c-02079a7fec73 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:17.520692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cf8b2-067a-4f27-b32c-02079a7fec73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.522288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685cf8b2-067a-4f27-b32c-02079a7fec73 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.532129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 452/908] 10.222.0.48 () {56 vars in 1136 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:17.534123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dffe6e-e208-43e4-8d3b-ae4ad3ea424c None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.534412 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dffe6e-e208-43e4-8d3b-ae4ad3ea424c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.534944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dffe6e-e208-43e4-8d3b-ae4ad3ea424c None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.539593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 457/909] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:17.540689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cf8b2-067a-4f27-b32c-02079a7fec73 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.541863 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7d1e3-2309-4014-aade-f90049f698a8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.542162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7d1e3-2309-4014-aade-f90049f698a8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.542448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7d1e3-2309-4014-aade-f90049f698a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.557424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685cf8b2-067a-4f27-b32c-02079a7fec73 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.561486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-10d7d1e3-2309-4014-aade-f90049f698a8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:17.562321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fbaeb-e0b7-425a-be31-59dd564809c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.562676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-10d7d1e3-2309-4014-aade-f90049f698a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:17.563106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbaeb-e0b7-425a-be31-59dd564809c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.563390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbaeb-e0b7-425a-be31-59dd564809c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.563712 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970fbaeb-e0b7-425a-be31-59dd564809c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.571786 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 458/910] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:17 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:17.572854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fdeb1-c09b-4cb3-b6cf-136308991302 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.573144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fdeb1-c09b-4cb3-b6cf-136308991302 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.573422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4fdeb1-c09b-4cb3-b6cf-136308991302 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.575195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 459/911] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:17.577340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fbaeb-e0b7-425a-be31-59dd564809c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.579518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970fbaeb-e0b7-425a-be31-59dd564809c6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.580574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706290-0e14-40d4-b7f2-2a60ae6d5313 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.580864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706290-0e14-40d4-b7f2-2a60ae6d5313 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.581146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f706290-0e14-40d4-b7f2-2a60ae6d5313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.599269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2f706290-0e14-40d4-b7f2-2a60ae6d5313 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:17.600126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-970fbaeb-e0b7-425a-be31-59dd564809c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:17.600487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2f706290-0e14-40d4-b7f2-2a60ae6d5313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:17.602030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 453/912] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:17.603179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fbaeb-e0b7-425a-be31-59dd564809c6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.608986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 460/913] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:17 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:17.610820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706290-0e14-40d4-b7f2-2a60ae6d5313 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.614848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970fbaeb-e0b7-425a-be31-59dd564809c6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.620355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00ba37-99c4-4326-b192-dfb1500a5204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.620755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f706290-0e14-40d4-b7f2-2a60ae6d5313 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.621534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00ba37-99c4-4326-b192-dfb1500a5204 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.622088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00ba37-99c4-4326-b192-dfb1500a5204 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.622594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00ba37-99c4-4326-b192-dfb1500a5204 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.623799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00ba37-99c4-4326-b192-dfb1500a5204 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.625792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00ba37-99c4-4326-b192-dfb1500a5204 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.626075 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bd5cd-323b-4eb2-811c-f84a18dc606e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.626827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bd5cd-323b-4eb2-811c-f84a18dc606e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.627227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bd5cd-323b-4eb2-811c-f84a18dc606e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.627644 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bd5cd-323b-4eb2-811c-f84a18dc606e admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.628573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bd5cd-323b-4eb2-811c-f84a18dc606e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:17.628903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bd5cd-323b-4eb2-811c-f84a18dc606e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.630686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2bd5cd-323b-4eb2-811c-f84a18dc606e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.638970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-0e00ba37-99c4-4326-b192-dfb1500a5204 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jan 27 16:37:17.640565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 454/914] 10.222.0.48 () {56 vars in 1153 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:17.641314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00ba37-99c4-4326-b192-dfb1500a5204 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.644385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 461/915] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:17.649763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bd5cd-323b-4eb2-811c-f84a18dc606e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.659260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00ba37-99c4-4326-b192-dfb1500a5204 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.659912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bd5cd-323b-4eb2-811c-f84a18dc606e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.664100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966966c5-bf82-402f-abe9-b19f42aa2ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.664294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368a915-762a-47f0-82c5-2667bfabc07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.664861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966966c5-bf82-402f-abe9-b19f42aa2ecf admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.665071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368a915-762a-47f0-82c5-2667bfabc07a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.665165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966966c5-bf82-402f-abe9-b19f42aa2ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.665355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368a915-762a-47f0-82c5-2667bfabc07a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.665461 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966966c5-bf82-402f-abe9-b19f42aa2ecf admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.665632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368a915-762a-47f0-82c5-2667bfabc07a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.666039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966966c5-bf82-402f-abe9-b19f42aa2ecf admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.667805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966966c5-bf82-402f-abe9-b19f42aa2ecf admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.674192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368a915-762a-47f0-82c5-2667bfabc07a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.676229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368a915-762a-47f0-82c5-2667bfabc07a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.681324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-966966c5-bf82-402f-abe9-b19f42aa2ecf admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 27 16:37:17.682953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 455/916] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:17.691680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966966c5-bf82-402f-abe9-b19f42aa2ecf admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.691807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-8368a915-762a-47f0-82c5-2667bfabc07a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 27 16:37:17.691807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 462/917] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:17.692220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368a915-762a-47f0-82c5-2667bfabc07a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.702167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966966c5-bf82-402f-abe9-b19f42aa2ecf admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.705765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368a915-762a-47f0-82c5-2667bfabc07a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.706705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f5ac-9db4-46b2-bcef-40d891708cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.707350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f5ac-9db4-46b2-bcef-40d891708cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.707675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f5ac-9db4-46b2-bcef-40d891708cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.707958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f5ac-9db4-46b2-bcef-40d891708cb7 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.708672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f5ac-9db4-46b2-bcef-40d891708cb7 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:17.708969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f5ac-9db4-46b2-bcef-40d891708cb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.710544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3f5ac-9db4-46b2-bcef-40d891708cb7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.711604 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48101403-25f9-4612-94e7-6f05546d0e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.712246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48101403-25f9-4612-94e7-6f05546d0e47 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.712528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48101403-25f9-4612-94e7-6f05546d0e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.712805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48101403-25f9-4612-94e7-6f05546d0e47 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.713594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48101403-25f9-4612-94e7-6f05546d0e47 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:17.713816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48101403-25f9-4612-94e7-6f05546d0e47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.715375 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48101403-25f9-4612-94e7-6f05546d0e47 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.715536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 456/918] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:17.716320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f5ac-9db4-46b2-bcef-40d891708cb7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.723741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 463/919] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:17.723741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48101403-25f9-4612-94e7-6f05546d0e47 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.728777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f5ac-9db4-46b2-bcef-40d891708cb7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.731140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48101403-25f9-4612-94e7-6f05546d0e47 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.733347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57284-8c2a-4cdf-b78c-230dd836cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.733997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57284-8c2a-4cdf-b78c-230dd836cf52 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.734281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57284-8c2a-4cdf-b78c-230dd836cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.734560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a57284-8c2a-4cdf-b78c-230dd836cf52 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.735391 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57284-8c2a-4cdf-b78c-230dd836cf52 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:17.735731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57284-8c2a-4cdf-b78c-230dd836cf52 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.737545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a57284-8c2a-4cdf-b78c-230dd836cf52 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.739174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a911-24cb-4d4f-aaba-b94820551e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.739751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a911-24cb-4d4f-aaba-b94820551e4f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.740669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a911-24cb-4d4f-aaba-b94820551e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.740669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264a911-24cb-4d4f-aaba-b94820551e4f admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.741037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264a911-24cb-4d4f-aaba-b94820551e4f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:17.741288 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264a911-24cb-4d4f-aaba-b94820551e4f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.742831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264a911-24cb-4d4f-aaba-b94820551e4f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.752687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 464/920] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:17.752687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a911-24cb-4d4f-aaba-b94820551e4f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.755028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 457/921] 10.222.0.48 () {56 vars in 1170 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:17.759399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57284-8c2a-4cdf-b78c-230dd836cf52 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.761855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264a911-24cb-4d4f-aaba-b94820551e4f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.767880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d6fc9-3810-4c71-aa15-0fe4d0329282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.768654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6fc9-3810-4c71-aa15-0fe4d0329282 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.769011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6fc9-3810-4c71-aa15-0fe4d0329282 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.769184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a57284-8c2a-4cdf-b78c-230dd836cf52 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.769408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d6fc9-3810-4c71-aa15-0fe4d0329282 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.770196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d6fc9-3810-4c71-aa15-0fe4d0329282 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:17.770571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d6fc9-3810-4c71-aa15-0fe4d0329282 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.772263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d6fc9-3810-4c71-aa15-0fe4d0329282 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.773575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3a27b-a110-490d-ab9b-97195594281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.774214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3a27b-a110-490d-ab9b-97195594281c admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.774498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3a27b-a110-490d-ab9b-97195594281c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.774774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3a27b-a110-490d-ab9b-97195594281c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.775529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3a27b-a110-490d-ab9b-97195594281c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.777293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3a27b-a110-490d-ab9b-97195594281c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.777402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 465/922] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:17.783391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d6fc9-3810-4c71-aa15-0fe4d0329282 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.793882 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d6fc9-3810-4c71-aa15-0fe4d0329282 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.796985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 458/923] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jan 27 16:37:17 2022] POST /identity/v3/endpoints => generated 347 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:17.797819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3a27b-a110-490d-ab9b-97195594281c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.822937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a86e-af57-414e-819f-dfb9e1c44d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.824081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a86e-af57-414e-819f-dfb9e1c44d5e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.824519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a86e-af57-414e-819f-dfb9e1c44d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.825440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9a86e-af57-414e-819f-dfb9e1c44d5e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.830397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3a27b-a110-490d-ab9b-97195594281c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.835604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb767b-d45d-42ff-808c-c07e38be76a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.836290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb767b-d45d-42ff-808c-c07e38be76a2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.836581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb767b-d45d-42ff-808c-c07e38be76a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.836857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb767b-d45d-42ff-808c-c07e38be76a2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.838328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb767b-d45d-42ff-808c-c07e38be76a2 admin admin] RBAC: Adding query filter params (interface=public, service_id=af001afca2254299b5200f0a74228a44, region_id=RegionOne) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:17.838660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb767b-d45d-42ff-808c-c07e38be76a2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.840836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb767b-d45d-42ff-808c-c07e38be76a2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.842889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a86e-af57-414e-819f-dfb9e1c44d5e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.846407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9a86e-af57-414e-819f-dfb9e1c44d5e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.847656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 459/924] 10.222.0.48 () {56 vars in 1272 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/endpoints?service_id=af001afca2254299b5200f0a74228a44&interface=public®ion_id=RegionOne => generated 194 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:17.862433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb767b-d45d-42ff-808c-c07e38be76a2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.871984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-32b9a86e-af57-414e-819f-dfb9e1c44d5e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:17.872774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb767b-d45d-42ff-808c-c07e38be76a2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.874493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 466/925] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:17.880469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a86e-af57-414e-819f-dfb9e1c44d5e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.881314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f563b3-259d-40a7-96b3-9565426e6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.882557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f563b3-259d-40a7-96b3-9565426e6bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.886589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f563b3-259d-40a7-96b3-9565426e6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.887058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f563b3-259d-40a7-96b3-9565426e6bb4 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.888294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f563b3-259d-40a7-96b3-9565426e6bb4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.891187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f563b3-259d-40a7-96b3-9565426e6bb4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.897543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9a86e-af57-414e-819f-dfb9e1c44d5e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.899187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 460/926] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/services => generated 1497 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:37:17.912118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c898b9-68d4-4173-baaf-4833145d8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.913143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c898b9-68d4-4173-baaf-4833145d8219 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.913579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c898b9-68d4-4173-baaf-4833145d8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.914065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c898b9-68d4-4173-baaf-4833145d8219 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.915033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c898b9-68d4-4173-baaf-4833145d8219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:17.915540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c898b9-68d4-4173-baaf-4833145d8219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.917510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c898b9-68d4-4173-baaf-4833145d8219 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.934834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 467/927] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:17.941034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f563b3-259d-40a7-96b3-9565426e6bb4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:17.952391 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f563b3-259d-40a7-96b3-9565426e6bb4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:17.957785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee16f2-54de-4448-a04c-e09e5850b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:17.958929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee16f2-54de-4448-a04c-e09e5850b0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:17.959370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee16f2-54de-4448-a04c-e09e5850b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:17.959915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee16f2-54de-4448-a04c-e09e5850b0e9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:17.969022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee16f2-54de-4448-a04c-e09e5850b0e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:17.971438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee16f2-54de-4448-a04c-e09e5850b0e9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:17.987591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-e8ee16f2-54de-4448-a04c-e09e5850b0e9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:17.989420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 461/928] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:17.994971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c898b9-68d4-4173-baaf-4833145d8219 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:18.006787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c898b9-68d4-4173-baaf-4833145d8219 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:18.013554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5a87c-0963-4e39-abd6-f97a06446d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:18.014748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5a87c-0963-4e39-abd6-f97a06446d41 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:18.015215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5a87c-0963-4e39-abd6-f97a06446d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:18.015622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5a87c-0963-4e39-abd6-f97a06446d41 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:18.016556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5a87c-0963-4e39-abd6-f97a06446d41 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:18.016967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5a87c-0963-4e39-abd6-f97a06446d41 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:18.019012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5a87c-0963-4e39-abd6-f97a06446d41 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:18.033184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 468/929] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:18.039540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee16f2-54de-4448-a04c-e09e5850b0e9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:18.051761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee16f2-54de-4448-a04c-e09e5850b0e9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:18.056981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d567b1e-5167-4817-bc8f-c6ebf55433f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:18.058158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d567b1e-5167-4817-bc8f-c6ebf55433f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:18.058646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d567b1e-5167-4817-bc8f-c6ebf55433f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:18.059068 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d567b1e-5167-4817-bc8f-c6ebf55433f3 admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/531ce85d5104400fa5adec42d30f399b/roles/6dc9a8ecd98b4fab8314890bf5b2bad9` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:18.062404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d567b1e-5167-4817-bc8f-c6ebf55433f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=531ce85d5104400fa5adec42d30f399b, role_id=6dc9a8ecd98b4fab8314890bf5b2bad9)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:18.065581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d567b1e-5167-4817-bc8f-c6ebf55433f3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:18.084529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 462/930] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:37:18 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/531ce85d5104400fa5adec42d30f399b/roles/6dc9a8ecd98b4fab8314890bf5b2bad9 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:37:18.378721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec5eb-b927-484d-8d82-aa09fcece171 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:18.379017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec5eb-b927-484d-8d82-aa09fcece171 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:18.379298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deec5eb-b927-484d-8d82-aa09fcece171 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:18.381378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 469/931] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:18.386636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdbb96-5afe-4bf1-a622-52215920a758 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:18.386937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdbb96-5afe-4bf1-a622-52215920a758 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:18.387220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdbb96-5afe-4bf1-a622-52215920a758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:18.405900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1afdbb96-5afe-4bf1-a622-52215920a758 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:18.407076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1afdbb96-5afe-4bf1-a622-52215920a758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:18.464859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 463/932] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:18 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:18.489352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec5eb-b927-484d-8d82-aa09fcece171 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:18.504392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deec5eb-b927-484d-8d82-aa09fcece171 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:18.508828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e94668-bddb-418b-bfab-3ea5fb15ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:18.509618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e94668-bddb-418b-bfab-3ea5fb15ad16 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:18.509899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e94668-bddb-418b-bfab-3ea5fb15ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:18.510232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e94668-bddb-418b-bfab-3ea5fb15ad16 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:18.510969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e94668-bddb-418b-bfab-3ea5fb15ad16 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:18.512621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e94668-bddb-418b-bfab-3ea5fb15ad16 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:18.524206 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-32e94668-bddb-418b-bfab-3ea5fb15ad16 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 27 16:37:18.530511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 470/933] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:18.531928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdbb96-5afe-4bf1-a622-52215920a758 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:18.541232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdbb96-5afe-4bf1-a622-52215920a758 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:18.547970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08148-7bca-4c6d-8089-83dcb251ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:18.548645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08148-7bca-4c6d-8089-83dcb251ecb2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:18.548979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08148-7bca-4c6d-8089-83dcb251ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:18.549254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08148-7bca-4c6d-8089-83dcb251ecb2 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:18.549987 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d08148-7bca-4c6d-8089-83dcb251ecb2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:18.550292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d08148-7bca-4c6d-8089-83dcb251ecb2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:18.551976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d08148-7bca-4c6d-8089-83dcb251ecb2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:18.562357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 464/934] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:18.563704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e94668-bddb-418b-bfab-3ea5fb15ad16 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:18.573615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e94668-bddb-418b-bfab-3ea5fb15ad16 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:18.582316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51b599-747d-4e42-b54e-03f568e9c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:18.583211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51b599-747d-4e42-b54e-03f568e9c038 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:18.583498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51b599-747d-4e42-b54e-03f568e9c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:18.583803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51b599-747d-4e42-b54e-03f568e9c038 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:18.584579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51b599-747d-4e42-b54e-03f568e9c038 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:18.584886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51b599-747d-4e42-b54e-03f568e9c038 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:18.586588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51b599-747d-4e42-b54e-03f568e9c038 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:18.596932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 471/935] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:18.598314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08148-7bca-4c6d-8089-83dcb251ecb2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:18.609034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08148-7bca-4c6d-8089-83dcb251ecb2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:18.613803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2944dd-3ffa-4a39-8da7-c86f565dcec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:18.614500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2944dd-3ffa-4a39-8da7-c86f565dcec1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:18.614786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2944dd-3ffa-4a39-8da7-c86f565dcec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:18.615116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2944dd-3ffa-4a39-8da7-c86f565dcec1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:18.615968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2944dd-3ffa-4a39-8da7-c86f565dcec1 admin admin] RBAC: Adding query filter params (interface=public, service_id=4ee943e1cf5e4057b16ab18041c4cc8e, region_id=RegionOne) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:18.616334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2944dd-3ffa-4a39-8da7-c86f565dcec1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:18.617970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2944dd-3ffa-4a39-8da7-c86f565dcec1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:18.623914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 465/936] 10.222.0.48 () {56 vars in 1272 bytes} [Thu Jan 27 16:37:18 2022] GET /identity/v3/endpoints?service_id=4ee943e1cf5e4057b16ab18041c4cc8e&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:18.633121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51b599-747d-4e42-b54e-03f568e9c038 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:18.643743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51b599-747d-4e42-b54e-03f568e9c038 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:18.648477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11568eae-2e6e-446f-8fc2-fd3bd6a45245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:18.649134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11568eae-2e6e-446f-8fc2-fd3bd6a45245 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:18.649415 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11568eae-2e6e-446f-8fc2-fd3bd6a45245 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:18.649692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11568eae-2e6e-446f-8fc2-fd3bd6a45245 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:18.650440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11568eae-2e6e-446f-8fc2-fd3bd6a45245 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:18.652233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11568eae-2e6e-446f-8fc2-fd3bd6a45245 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:18.667745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 472/937] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:37:18 2022] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:37:20.158949 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60d9c1-a635-46ae-a41d-5f0a7fa9226c None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.159968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60d9c1-a635-46ae-a41d-5f0a7fa9226c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.159968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60d9c1-a635-46ae-a41d-5f0a7fa9226c None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.161845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 466/938] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:20.167199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4102-f8d4-4b8d-a922-1d3b5b0e5af4 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.167711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4102-f8d4-4b8d-a922-1d3b5b0e5af4 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.167954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4102-f8d4-4b8d-a922-1d3b5b0e5af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.185948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-017b4102-f8d4-4b8d-a922-1d3b5b0e5af4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:20.187459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-017b4102-f8d4-4b8d-a922-1d3b5b0e5af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:20.195901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 473/939] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:20 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:20.205466 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54da6b-17c1-40ab-9c57-535f5c82ffed None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.205753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54da6b-17c1-40ab-9c57-535f5c82ffed None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.206035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54da6b-17c1-40ab-9c57-535f5c82ffed None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.208067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 467/940] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:20.213106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf488817-a326-4a2d-ab95-4befe136b2eb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.213399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf488817-a326-4a2d-ab95-4befe136b2eb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.213680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf488817-a326-4a2d-ab95-4befe136b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.220498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54da6b-17c1-40ab-9c57-535f5c82ffed None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.232680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-cf488817-a326-4a2d-ab95-4befe136b2eb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:20.234178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-cf488817-a326-4a2d-ab95-4befe136b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:20.234410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54da6b-17c1-40ab-9c57-535f5c82ffed None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.243321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e79237-d4a7-474e-a351-267961cb5ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.244046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 474/941] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:20 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:20.244152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e79237-d4a7-474e-a351-267961cb5ffe admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.247601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e79237-d4a7-474e-a351-267961cb5ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.247601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e79237-d4a7-474e-a351-267961cb5ffe admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.247601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e79237-d4a7-474e-a351-267961cb5ffe admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.247601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e79237-d4a7-474e-a351-267961cb5ffe admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.258968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-22e79237-d4a7-474e-a351-267961cb5ffe admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 27 16:37:20.260548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 468/942] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:20.268818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf488817-a326-4a2d-ab95-4befe136b2eb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.273289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e79237-d4a7-474e-a351-267961cb5ffe admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.278997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf488817-a326-4a2d-ab95-4befe136b2eb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.284304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc00fb6-17d0-4fd1-aebc-e1a55505bdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.285218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00fb6-17d0-4fd1-aebc-e1a55505bdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.285501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00fb6-17d0-4fd1-aebc-e1a55505bdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.285777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00fb6-17d0-4fd1-aebc-e1a55505bdc5 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.286529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc00fb6-17d0-4fd1-aebc-e1a55505bdc5 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:20.286840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc00fb6-17d0-4fd1-aebc-e1a55505bdc5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.287367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e79237-d4a7-474e-a351-267961cb5ffe admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.288476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc00fb6-17d0-4fd1-aebc-e1a55505bdc5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.293137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7034ee-c95a-4083-a535-24479936c95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.298214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 475/943] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:20.298336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7034ee-c95a-4083-a535-24479936c95c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.298336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7034ee-c95a-4083-a535-24479936c95c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.298336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7034ee-c95a-4083-a535-24479936c95c admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.298336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7034ee-c95a-4083-a535-24479936c95c admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.299968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc00fb6-17d0-4fd1-aebc-e1a55505bdc5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.300532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7034ee-c95a-4083-a535-24479936c95c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.312716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc00fb6-17d0-4fd1-aebc-e1a55505bdc5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.317472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7477e0-4b3c-4518-9aa7-3023241be991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.317841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-aa7034ee-c95a-4083-a535-24479936c95c admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jan 27 16:37:20.318569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7477e0-4b3c-4518-9aa7-3023241be991 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.323599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7477e0-4b3c-4518-9aa7-3023241be991 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.323718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 469/944] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:20.323808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7477e0-4b3c-4518-9aa7-3023241be991 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.323808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7477e0-4b3c-4518-9aa7-3023241be991 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:20.323808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7477e0-4b3c-4518-9aa7-3023241be991 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.323808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7477e0-4b3c-4518-9aa7-3023241be991 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.325798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7034ee-c95a-4083-a535-24479936c95c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.336259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 476/945] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:20.340411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7034ee-c95a-4083-a535-24479936c95c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.346345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5993ef0-6ce8-4fe4-9fc3-269460aea615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.347025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993ef0-6ce8-4fe4-9fc3-269460aea615 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.347305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993ef0-6ce8-4fe4-9fc3-269460aea615 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.347597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993ef0-6ce8-4fe4-9fc3-269460aea615 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.348369 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5993ef0-6ce8-4fe4-9fc3-269460aea615 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:20.348677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5993ef0-6ce8-4fe4-9fc3-269460aea615 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.350330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5993ef0-6ce8-4fe4-9fc3-269460aea615 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.356061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 470/946] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:20.363117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7477e0-4b3c-4518-9aa7-3023241be991 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.374259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7477e0-4b3c-4518-9aa7-3023241be991 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.379542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712eed9-65d7-4663-8644-e1691cc8c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.380846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712eed9-65d7-4663-8644-e1691cc8c679 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.381037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75fc5f-419a-42cb-a654-8f7750c11b3f None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.381136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712eed9-65d7-4663-8644-e1691cc8c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.381373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75fc5f-419a-42cb-a654-8f7750c11b3f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.381476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712eed9-65d7-4663-8644-e1691cc8c679 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.381657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75fc5f-419a-42cb-a654-8f7750c11b3f None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.382242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712eed9-65d7-4663-8644-e1691cc8c679 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:20.382553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712eed9-65d7-4663-8644-e1691cc8c679 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.383706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 471/947] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:20.384247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712eed9-65d7-4663-8644-e1691cc8c679 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.389451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2386-1ad9-4712-bae2-46b3e454fba5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.389724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2386-1ad9-4712-bae2-46b3e454fba5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.390002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2386-1ad9-4712-bae2-46b3e454fba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.392840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 477/948] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:20.398440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712eed9-65d7-4663-8644-e1691cc8c679 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.410011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712eed9-65d7-4663-8644-e1691cc8c679 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.411847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e63a2386-1ad9-4712-bae2-46b3e454fba5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:20.413282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e63a2386-1ad9-4712-bae2-46b3e454fba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:20.415823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2643d-f0f3-427b-92bc-9bed1ace3929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.416866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2643d-f0f3-427b-92bc-9bed1ace3929 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.417406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2643d-f0f3-427b-92bc-9bed1ace3929 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.417852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2643d-f0f3-427b-92bc-9bed1ace3929 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.418799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2643d-f0f3-427b-92bc-9bed1ace3929 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.421497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2643d-f0f3-427b-92bc-9bed1ace3929 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.431597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 472/949] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:20 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:20.447672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 478/950] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jan 27 16:37:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:37:20.453595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2386-1ad9-4712-bae2-46b3e454fba5 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.463602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2386-1ad9-4712-bae2-46b3e454fba5 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.481006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dbb6d-1aa1-49eb-9d7f-9a2471f16d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.481888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dbb6d-1aa1-49eb-9d7f-9a2471f16d4f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.482172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dbb6d-1aa1-49eb-9d7f-9a2471f16d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.483043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82dbb6d-1aa1-49eb-9d7f-9a2471f16d4f admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.500810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82dbb6d-1aa1-49eb-9d7f-9a2471f16d4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:20.508717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c82dbb6d-1aa1-49eb-9d7f-9a2471f16d4f admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 27 16:37:20.510437 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 473/951] 10.222.0.48 () {56 vars in 1141 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:20.516648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2643d-f0f3-427b-92bc-9bed1ace3929 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.527897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2643d-f0f3-427b-92bc-9bed1ace3929 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.534453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5fd2e-f5c5-48d8-afe8-1f5396d3bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.535398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5fd2e-f5c5-48d8-afe8-1f5396d3bddd admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.535743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5fd2e-f5c5-48d8-afe8-1f5396d3bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.536025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5fd2e-f5c5-48d8-afe8-1f5396d3bddd admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.536805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5fd2e-f5c5-48d8-afe8-1f5396d3bddd admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:20.537117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5fd2e-f5c5-48d8-afe8-1f5396d3bddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.538747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5fd2e-f5c5-48d8-afe8-1f5396d3bddd admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.550183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 479/952] 10.222.0.48 () {56 vars in 1136 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:20.555955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dbb6d-1aa1-49eb-9d7f-9a2471f16d4f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.570482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82dbb6d-1aa1-49eb-9d7f-9a2471f16d4f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.575281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f9d48-1731-44dc-8910-558739bdf385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.576408 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f9d48-1731-44dc-8910-558739bdf385 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.576864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f9d48-1731-44dc-8910-558739bdf385 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.577251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f9d48-1731-44dc-8910-558739bdf385 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.590080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f9d48-1731-44dc-8910-558739bdf385 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.592763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f9d48-1731-44dc-8910-558739bdf385 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.611737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-5c8f9d48-1731-44dc-8910-558739bdf385 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:20.613315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 474/953] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:20.619083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5fd2e-f5c5-48d8-afe8-1f5396d3bddd admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.630087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5fd2e-f5c5-48d8-afe8-1f5396d3bddd admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.634852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5010a-fca4-4c29-a9e6-c9ceb9e49ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.635615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5010a-fca4-4c29-a9e6-c9ceb9e49ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.635891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5010a-fca4-4c29-a9e6-c9ceb9e49ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.636219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5010a-fca4-4c29-a9e6-c9ceb9e49ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.636965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5010a-fca4-4c29-a9e6-c9ceb9e49ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:20.637274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5010a-fca4-4c29-a9e6-c9ceb9e49ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.639085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5010a-fca4-4c29-a9e6-c9ceb9e49ce8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.651914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 480/954] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:20.657964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f9d48-1731-44dc-8910-558739bdf385 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.668610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f9d48-1731-44dc-8910-558739bdf385 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.673925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3bd6d-fa8e-487a-a01d-f1572909b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.674742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3bd6d-fa8e-487a-a01d-f1572909b62d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.675031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3bd6d-fa8e-487a-a01d-f1572909b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.675313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3bd6d-fa8e-487a-a01d-f1572909b62d admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.683811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3bd6d-fa8e-487a-a01d-f1572909b62d admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.686136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3bd6d-fa8e-487a-a01d-f1572909b62d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.700606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-67e3bd6d-fa8e-487a-a01d-f1572909b62d admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jan 27 16:37:20.702751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 475/955] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:20.708672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5010a-fca4-4c29-a9e6-c9ceb9e49ce8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.719858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5010a-fca4-4c29-a9e6-c9ceb9e49ce8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.724714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddf004-017d-42f1-96b8-6005dca0bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.725412 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddf004-017d-42f1-96b8-6005dca0bda4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.725697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddf004-017d-42f1-96b8-6005dca0bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.725983 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eddf004-017d-42f1-96b8-6005dca0bda4 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.726861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddf004-017d-42f1-96b8-6005dca0bda4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:20.727178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddf004-017d-42f1-96b8-6005dca0bda4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.729168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eddf004-017d-42f1-96b8-6005dca0bda4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.748361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 481/956] 10.222.0.48 () {56 vars in 1170 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:20.754001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3bd6d-fa8e-487a-a01d-f1572909b62d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.765502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3bd6d-fa8e-487a-a01d-f1572909b62d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.770438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecb7b6-cb21-445f-b73f-e3d31d74dabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.771330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb7b6-cb21-445f-b73f-e3d31d74dabf admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.771830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb7b6-cb21-445f-b73f-e3d31d74dabf admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.772291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecb7b6-cb21-445f-b73f-e3d31d74dabf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.781576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecb7b6-cb21-445f-b73f-e3d31d74dabf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.783727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecb7b6-cb21-445f-b73f-e3d31d74dabf admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.793662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 476/957] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/auth/tokens => generated 2138 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:20.799595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddf004-017d-42f1-96b8-6005dca0bda4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.809645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eddf004-017d-42f1-96b8-6005dca0bda4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.814756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1e3a-ca2b-4983-8e2c-403c3e222d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.815909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1e3a-ca2b-4983-8e2c-403c3e222d5f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.816375 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1e3a-ca2b-4983-8e2c-403c3e222d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.816880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b1e3a-ca2b-4983-8e2c-403c3e222d5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.828485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b1e3a-ca2b-4983-8e2c-403c3e222d5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.830816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b1e3a-ca2b-4983-8e2c-403c3e222d5f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.850985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-ec3b1e3a-ca2b-4983-8e2c-403c3e222d5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:20.852923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 482/958] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:20.859070 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecb7b6-cb21-445f-b73f-e3d31d74dabf admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.868422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecb7b6-cb21-445f-b73f-e3d31d74dabf admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.873458 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7af493-36af-4e27-bfde-78d49fee3e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.874404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7af493-36af-4e27-bfde-78d49fee3e1d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.874867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7af493-36af-4e27-bfde-78d49fee3e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.875373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7af493-36af-4e27-bfde-78d49fee3e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.876375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7af493-36af-4e27-bfde-78d49fee3e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:20.876861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7af493-36af-4e27-bfde-78d49fee3e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.878751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7af493-36af-4e27-bfde-78d49fee3e1d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.894324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 477/959] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:20.899869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1e3a-ca2b-4983-8e2c-403c3e222d5f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.912339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b1e3a-ca2b-4983-8e2c-403c3e222d5f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.917411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52f021-850e-46c9-8f7e-572ea2515f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.918499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52f021-850e-46c9-8f7e-572ea2515f40 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.919067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52f021-850e-46c9-8f7e-572ea2515f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.919542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52f021-850e-46c9-8f7e-572ea2515f40 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.927300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52f021-850e-46c9-8f7e-572ea2515f40 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.929594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52f021-850e-46c9-8f7e-572ea2515f40 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.943165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-ff52f021-850e-46c9-8f7e-572ea2515f40 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:20.944629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 483/960] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:20.950886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7af493-36af-4e27-bfde-78d49fee3e1d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.961504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7af493-36af-4e27-bfde-78d49fee3e1d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:20.966357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce83d7-3f10-4618-bd9f-6a81a4e47863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:20.967744 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce83d7-3f10-4618-bd9f-6a81a4e47863 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.968226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce83d7-3f10-4618-bd9f-6a81a4e47863 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.968692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce83d7-3f10-4618-bd9f-6a81a4e47863 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.969013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aea00d-bbf4-473c-a560-734820750bbf None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.969357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aea00d-bbf4-473c-a560-734820750bbf None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.969647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aea00d-bbf4-473c-a560-734820750bbf None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.970294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce83d7-3f10-4618-bd9f-6a81a4e47863 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:20.970802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce83d7-3f10-4618-bd9f-6a81a4e47863 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:20.971626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 484/961] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:20.973283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce83d7-3f10-4618-bd9f-6a81a4e47863 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:20.976676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843401-3ede-4c0d-870d-e7ae557b2058 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:20.976942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843401-3ede-4c0d-870d-e7ae557b2058 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:20.977287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06843401-3ede-4c0d-870d-e7ae557b2058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:20.988667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 478/962] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:20.994825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce83d7-3f10-4618-bd9f-6a81a4e47863 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:20.999975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-06843401-3ede-4c0d-870d-e7ae557b2058 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:21.001348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-06843401-3ede-4c0d-870d-e7ae557b2058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:21.006088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce83d7-3f10-4618-bd9f-6a81a4e47863 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:21.010329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 485/963] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:20 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:21.011016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9e2eb-f429-4d90-91cc-63ecc440655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:21.011976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e2eb-f429-4d90-91cc-63ecc440655d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:21.012418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e2eb-f429-4d90-91cc-63ecc440655d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:21.012850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9e2eb-f429-4d90-91cc-63ecc440655d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:21.013854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9e2eb-f429-4d90-91cc-63ecc440655d admin admin] RBAC: Adding query filter params (role.id=6dc9a8ecd98b4fab8314890bf5b2bad9, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=531ce85d5104400fa5adec42d30f399b) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:21.014341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9e2eb-f429-4d90-91cc-63ecc440655d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:21.016359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9e2eb-f429-4d90-91cc-63ecc440655d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:21.022382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 479/964] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:20 2022] GET /identity/v3/role_assignments?user.id=531ce85d5104400fa5adec42d30f399b&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=6dc9a8ecd98b4fab8314890bf5b2bad9 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:21.036643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843401-3ede-4c0d-870d-e7ae557b2058 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:21.047452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06843401-3ede-4c0d-870d-e7ae557b2058 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:21.052476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fda045-05dc-4975-8d97-10e91cb2f95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:21.053448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fda045-05dc-4975-8d97-10e91cb2f95f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:21.053841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fda045-05dc-4975-8d97-10e91cb2f95f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:21.054188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fda045-05dc-4975-8d97-10e91cb2f95f admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:21.054960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fda045-05dc-4975-8d97-10e91cb2f95f admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:21.056805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fda045-05dc-4975-8d97-10e91cb2f95f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:21.069782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-d5fda045-05dc-4975-8d97-10e91cb2f95f admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 27 16:37:21.071237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 486/965] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:21.077537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9e2eb-f429-4d90-91cc-63ecc440655d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:21.089242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9e2eb-f429-4d90-91cc-63ecc440655d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:21.095157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6631-6eec-4dfc-b2ad-76d08b0b24e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:21.095881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6631-6eec-4dfc-b2ad-76d08b0b24e9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:21.096225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6631-6eec-4dfc-b2ad-76d08b0b24e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:21.096504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d6631-6eec-4dfc-b2ad-76d08b0b24e9 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:21.097288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6631-6eec-4dfc-b2ad-76d08b0b24e9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:21.097601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6631-6eec-4dfc-b2ad-76d08b0b24e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:21.099297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d6631-6eec-4dfc-b2ad-76d08b0b24e9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:21.105407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 480/966] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:21.112012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fda045-05dc-4975-8d97-10e91cb2f95f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:21.122984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fda045-05dc-4975-8d97-10e91cb2f95f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:21.128158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7401e6-477e-4f03-913b-bd36d0013c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:21.128891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7401e6-477e-4f03-913b-bd36d0013c8c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:21.129179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7401e6-477e-4f03-913b-bd36d0013c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:21.129461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7401e6-477e-4f03-913b-bd36d0013c8c admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:21.130256 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7401e6-477e-4f03-913b-bd36d0013c8c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:21.130575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7401e6-477e-4f03-913b-bd36d0013c8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:21.132484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7401e6-477e-4f03-913b-bd36d0013c8c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:21.138695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 487/967] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:21.144544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6631-6eec-4dfc-b2ad-76d08b0b24e9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:21.155636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d6631-6eec-4dfc-b2ad-76d08b0b24e9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:21.161153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393d844-decd-482b-803f-36488523f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:21.161883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393d844-decd-482b-803f-36488523f38d admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:21.162134 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393d844-decd-482b-803f-36488523f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:21.162414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393d844-decd-482b-803f-36488523f38d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:21.163338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393d844-decd-482b-803f-36488523f38d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:21.165065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393d844-decd-482b-803f-36488523f38d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:21.188679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 481/968] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jan 27 16:37:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:22.694640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd25a1-0f07-44c5-be78-44b1579eb98a None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:22.695679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd25a1-0f07-44c5-be78-44b1579eb98a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:22.696210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd25a1-0f07-44c5-be78-44b1579eb98a None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:22.698848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 488/969] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:22.705202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaef89-9712-48c7-bcfa-735cc1a0a1ed None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:22.706030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaef89-9712-48c7-bcfa-735cc1a0a1ed None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:22.706537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaef89-9712-48c7-bcfa-735cc1a0a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:22.724667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-23aaef89-9712-48c7-bcfa-735cc1a0a1ed None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:22.726156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-23aaef89-9712-48c7-bcfa-735cc1a0a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:22.742988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 482/970] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:22 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:22.767995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd25a1-0f07-44c5-be78-44b1579eb98a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:22.780919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd25a1-0f07-44c5-be78-44b1579eb98a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:22.786033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0371e-80b2-4d4e-8d50-c9b491c8505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:22.786938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0371e-80b2-4d4e-8d50-c9b491c8505a admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:22.787423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0371e-80b2-4d4e-8d50-c9b491c8505a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:22.787944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0371e-80b2-4d4e-8d50-c9b491c8505a admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:22.788889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0371e-80b2-4d4e-8d50-c9b491c8505a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:22.790708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0371e-80b2-4d4e-8d50-c9b491c8505a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:22.803890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751acf7-6bf1-4cbe-a467-543066f8cc12 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:22.804205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751acf7-6bf1-4cbe-a467-543066f8cc12 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:22.804402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751acf7-6bf1-4cbe-a467-543066f8cc12 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:22.806149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 483/971] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:22.807239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 489/972] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:37:22 2022] POST /identity/v3/services => generated 242 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:22.812434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417cbc9-ce01-434c-add3-30dc551f0ece None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:22.812724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417cbc9-ce01-434c-add3-30dc551f0ece None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:22.813008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417cbc9-ce01-434c-add3-30dc551f0ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:22.833088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-5417cbc9-ce01-434c-add3-30dc551f0ece None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:22.834422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5417cbc9-ce01-434c-add3-30dc551f0ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:22.853052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 484/973] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:22 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:22.878857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0371e-80b2-4d4e-8d50-c9b491c8505a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:22.890948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0371e-80b2-4d4e-8d50-c9b491c8505a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:22.896221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:22.897276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:22.897758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:22.898244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:22.899227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:22.901493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:22.903152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.common [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 27 16:37:22.927509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.sql.core [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jan 27 16:37:22.927509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jan 27 16:37:22.927509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [parameters: {'id': '37685ff826114293b579910f5a35c95a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jan 27 16:37:22.927509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90784) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 27 16:37:22.944384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37685ff826114293b579910f5a35c95a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37685ff826114293b579910f5a35c95a. Jan 27 16:37:22.946642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 490/974] 10.222.0.48 () {60 vars in 1161 bytes} [Thu Jan 27 16:37:22 2022] POST /identity/v3/projects => generated 262 bytes in 68 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:22.953173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417cbc9-ce01-434c-add3-30dc551f0ece None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:22.964332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417cbc9-ce01-434c-add3-30dc551f0ece None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:22.974400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e6e36-d7cd-4703-86c4-3d98ff42b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:22.975852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e6e36-d7cd-4703-86c4-3d98ff42b76f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:22.976421 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e6e36-d7cd-4703-86c4-3d98ff42b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:22.976968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e6e36-d7cd-4703-86c4-3d98ff42b76f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:22.985335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e6e36-d7cd-4703-86c4-3d98ff42b76f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:22.987709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e6e36-d7cd-4703-86c4-3d98ff42b76f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.001945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-554e6e36-d7cd-4703-86c4-3d98ff42b76f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:23.003464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 485/975] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:23.009735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:23.021333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c95d3-99e7-4ca7-9c89-55460521f2b0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:23.026378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557f06e-abcf-4388-816b-10cc9aa25784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:23.027429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557f06e-abcf-4388-816b-10cc9aa25784 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.027956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557f06e-abcf-4388-816b-10cc9aa25784 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.028441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557f06e-abcf-4388-816b-10cc9aa25784 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.030194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557f06e-abcf-4388-816b-10cc9aa25784 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:23.030907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557f06e-abcf-4388-816b-10cc9aa25784 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:23.033294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557f06e-abcf-4388-816b-10cc9aa25784 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.064129 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 491/976] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:23.386640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9873769-8407-4885-b360-9fd5049d2757 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.386972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9873769-8407-4885-b360-9fd5049d2757 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.387097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9873769-8407-4885-b360-9fd5049d2757 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.389343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 486/977] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:23.394988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c859-51fe-40bb-b9c4-ab6f7052b582 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.395282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c859-51fe-40bb-b9c4-ab6f7052b582 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.395593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c859-51fe-40bb-b9c4-ab6f7052b582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.418647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d7b8c859-51fe-40bb-b9c4-ab6f7052b582 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:23.421068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d7b8c859-51fe-40bb-b9c4-ab6f7052b582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:23.429707 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 492/978] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:23 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:23.452584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9873769-8407-4885-b360-9fd5049d2757 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:23.465686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9873769-8407-4885-b360-9fd5049d2757 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:23.471153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589e999-34a9-44d7-819f-2f564f86200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:23.472005 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589e999-34a9-44d7-819f-2f564f86200b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.472336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589e999-34a9-44d7-819f-2f564f86200b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.472610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589e999-34a9-44d7-819f-2f564f86200b admin admin] PATH_INFO: `/v3/services/image` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.473313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589e999-34a9-44d7-819f-2f564f86200b admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:23.474940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589e999-34a9-44d7-819f-2f564f86200b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.487147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-c589e999-34a9-44d7-819f-2f564f86200b admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 27 16:37:23.492320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 487/979] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jan 27 16:37:23 2022] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:23.497551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c859-51fe-40bb-b9c4-ab6f7052b582 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:23.508787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c859-51fe-40bb-b9c4-ab6f7052b582 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:23.513437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150c5be-d292-4dd8-be0a-855fc470f4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:23.515329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f21ab9-90cc-4e27-9561-28ede56fc18a None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.515460 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150c5be-d292-4dd8-be0a-855fc470f4bc admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.515648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f21ab9-90cc-4e27-9561-28ede56fc18a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.515749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150c5be-d292-4dd8-be0a-855fc470f4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.515924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f21ab9-90cc-4e27-9561-28ede56fc18a None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.516016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150c5be-d292-4dd8-be0a-855fc470f4bc admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.516719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150c5be-d292-4dd8-be0a-855fc470f4bc admin admin] RBAC: Adding query filter params (name=image) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:23.517029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150c5be-d292-4dd8-be0a-855fc470f4bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:23.517910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 488/980] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:23.518660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150c5be-d292-4dd8-be0a-855fc470f4bc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.524430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d97ab-eaad-45bf-8e32-89df33c26fbd None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.525233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d97ab-eaad-45bf-8e32-89df33c26fbd None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.525705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d97ab-eaad-45bf-8e32-89df33c26fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.531609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 493/981] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:23.535371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150c5be-d292-4dd8-be0a-855fc470f4bc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:23.545757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150c5be-d292-4dd8-be0a-855fc470f4bc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:23.548846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2c4d97ab-eaad-45bf-8e32-89df33c26fbd None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:23.550094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2c4d97ab-eaad-45bf-8e32-89df33c26fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:23.552531 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cd0a-a751-49bf-b367-6321e56614ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:23.553512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cd0a-a751-49bf-b367-6321e56614ec admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.553988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cd0a-a751-49bf-b367-6321e56614ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.554554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9cd0a-a751-49bf-b367-6321e56614ec admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.555461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cd0a-a751-49bf-b367-6321e56614ec admin admin] RBAC: Adding query filter params (type=image) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:23.555995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cd0a-a751-49bf-b367-6321e56614ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:23.557938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9cd0a-a751-49bf-b367-6321e56614ec admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.558938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 489/982] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:23 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:23.571735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 494/983] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:23.584215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d97ab-eaad-45bf-8e32-89df33c26fbd None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:23.594755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d97ab-eaad-45bf-8e32-89df33c26fbd None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:23.599841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232ae48-b918-40de-8400-8879790444c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:23.600718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232ae48-b918-40de-8400-8879790444c4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.601056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232ae48-b918-40de-8400-8879790444c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.601337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232ae48-b918-40de-8400-8879790444c4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.602020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232ae48-b918-40de-8400-8879790444c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:23.603804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232ae48-b918-40de-8400-8879790444c4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.617683 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-8232ae48-b918-40de-8400-8879790444c4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 27 16:37:23.618946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 490/984] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:23.625904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cd0a-a751-49bf-b367-6321e56614ec admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:23.636572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9cd0a-a751-49bf-b367-6321e56614ec admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:23.642109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d0132-09d0-492c-a39f-88ebfb1591ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:23.642768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d0132-09d0-492c-a39f-88ebfb1591ed admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.643172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d0132-09d0-492c-a39f-88ebfb1591ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.643589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d0132-09d0-492c-a39f-88ebfb1591ed admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.644630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d0132-09d0-492c-a39f-88ebfb1591ed admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:23.645006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d0132-09d0-492c-a39f-88ebfb1591ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:23.646627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11d0132-09d0-492c-a39f-88ebfb1591ed admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.652839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 495/985] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:23.660249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232ae48-b918-40de-8400-8879790444c4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:23.672513 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232ae48-b918-40de-8400-8879790444c4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:23.677483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68fd42-57e9-407d-acbc-e242cba7a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:23.678215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68fd42-57e9-407d-acbc-e242cba7a779 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.678501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68fd42-57e9-407d-acbc-e242cba7a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.678783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68fd42-57e9-407d-acbc-e242cba7a779 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.679588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68fd42-57e9-407d-acbc-e242cba7a779 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:23.679910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68fd42-57e9-407d-acbc-e242cba7a779 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:23.681632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68fd42-57e9-407d-acbc-e242cba7a779 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.687659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 491/986] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:23.693684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d0132-09d0-492c-a39f-88ebfb1591ed admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:23.704878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11d0132-09d0-492c-a39f-88ebfb1591ed admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:23.710261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933c0f3-bead-41e7-8bd1-aebf57116e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:23.710998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c0f3-bead-41e7-8bd1-aebf57116e30 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.711285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c0f3-bead-41e7-8bd1-aebf57116e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.711646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933c0f3-bead-41e7-8bd1-aebf57116e30 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.712473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c0f3-bead-41e7-8bd1-aebf57116e30 admin admin] RBAC: Adding query filter params (interface=admin, service_id=4ee943e1cf5e4057b16ab18041c4cc8e, region_id=RegionOne) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:23.712843 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c0f3-bead-41e7-8bd1-aebf57116e30 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:23.714611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933c0f3-bead-41e7-8bd1-aebf57116e30 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.721326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 496/987] 10.222.0.48 () {56 vars in 1270 bytes} [Thu Jan 27 16:37:23 2022] GET /identity/v3/endpoints?service_id=4ee943e1cf5e4057b16ab18041c4cc8e&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:23.727087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68fd42-57e9-407d-acbc-e242cba7a779 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:23.737886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68fd42-57e9-407d-acbc-e242cba7a779 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:23.743770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843e4f5-8425-4ffe-9acb-c5e154cfb2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:23.743770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843e4f5-8425-4ffe-9acb-c5e154cfb2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:23.744158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843e4f5-8425-4ffe-9acb-c5e154cfb2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:23.744298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843e4f5-8425-4ffe-9acb-c5e154cfb2b3 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:23.744999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843e4f5-8425-4ffe-9acb-c5e154cfb2b3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:23.746691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f843e4f5-8425-4ffe-9acb-c5e154cfb2b3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:23.753882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 492/988] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:37:23 2022] GET /identity/v3/services => generated 1727 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:37:25.181239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd918e-281a-462a-bd2a-8dea0a932c28 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.181944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd918e-281a-462a-bd2a-8dea0a932c28 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.181944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd918e-281a-462a-bd2a-8dea0a932c28 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.183596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 497/989] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:25.189285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e29b-33b2-4c49-87a9-eb9c22b4ef90 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.190051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e29b-33b2-4c49-87a9-eb9c22b4ef90 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.190502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e29b-33b2-4c49-87a9-eb9c22b4ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.209174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-16e3e29b-33b2-4c49-87a9-eb9c22b4ef90 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:25.210825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-16e3e29b-33b2-4c49-87a9-eb9c22b4ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:25.225450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 493/990] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:25 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:25.248733 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd918e-281a-462a-bd2a-8dea0a932c28 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:25.266894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd918e-281a-462a-bd2a-8dea0a932c28 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:25.271628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdfe94-3c1c-47dc-8e16-6867f98f7cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:25.272571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdfe94-3c1c-47dc-8e16-6867f98f7cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.273000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdfe94-3c1c-47dc-8e16-6867f98f7cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.273423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdfe94-3c1c-47dc-8e16-6867f98f7cf9 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.274269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdfe94-3c1c-47dc-8e16-6867f98f7cf9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:25.276027 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdfe94-3c1c-47dc-8e16-6867f98f7cf9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:25.288349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-76cdfe94-3c1c-47dc-8e16-6867f98f7cf9 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 27 16:37:25.290065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 498/991] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:25.296278 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3e29b-33b2-4c49-87a9-eb9c22b4ef90 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:25.305548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3e29b-33b2-4c49-87a9-eb9c22b4ef90 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:25.310305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd636a3-5415-46a5-aa20-92a467b8c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:25.311327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd636a3-5415-46a5-aa20-92a467b8c3ae admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.311804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd636a3-5415-46a5-aa20-92a467b8c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.312225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd636a3-5415-46a5-aa20-92a467b8c3ae admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.313114 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd636a3-5415-46a5-aa20-92a467b8c3ae admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:25.313567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd636a3-5415-46a5-aa20-92a467b8c3ae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:25.315300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd636a3-5415-46a5-aa20-92a467b8c3ae admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:25.320818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 494/992] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:25.327095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdfe94-3c1c-47dc-8e16-6867f98f7cf9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:25.337201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdfe94-3c1c-47dc-8e16-6867f98f7cf9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:25.342721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c6bbc-5bc6-4db3-b64b-0cb1d7d632c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:25.343774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c6bbc-5bc6-4db3-b64b-0cb1d7d632c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.344204 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c6bbc-5bc6-4db3-b64b-0cb1d7d632c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.344646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c6bbc-5bc6-4db3-b64b-0cb1d7d632c6 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.345524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c6bbc-5bc6-4db3-b64b-0cb1d7d632c6 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:25.345974 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c6bbc-5bc6-4db3-b64b-0cb1d7d632c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:25.347992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c6bbc-5bc6-4db3-b64b-0cb1d7d632c6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:25.356189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 499/993] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:25.363629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd636a3-5415-46a5-aa20-92a467b8c3ae admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:25.372948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd636a3-5415-46a5-aa20-92a467b8c3ae admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:25.377910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34a07-fe89-48b6-9542-19709e6984a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:25.378592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34a07-fe89-48b6-9542-19709e6984a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.378879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34a07-fe89-48b6-9542-19709e6984a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.379181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34a07-fe89-48b6-9542-19709e6984a1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.380027 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34a07-fe89-48b6-9542-19709e6984a1 admin admin] RBAC: Adding query filter params (interface=public, service_id=582ef913f8f949bd8300841723441670, region_id=RegionOne) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:25.380344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34a07-fe89-48b6-9542-19709e6984a1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:25.381934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34a07-fe89-48b6-9542-19709e6984a1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:25.387865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 495/994] 10.222.0.48 () {56 vars in 1272 bytes} [Thu Jan 27 16:37:25 2022] GET /identity/v3/endpoints?service_id=582ef913f8f949bd8300841723441670&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:25.391601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000fbb-cf10-43e2-8ba5-3d924abd427d None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.391901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000fbb-cf10-43e2-8ba5-3d924abd427d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.392185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000fbb-cf10-43e2-8ba5-3d924abd427d None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.393850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34a07-fe89-48b6-9542-19709e6984a1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:25.394246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 500/995] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:25.399159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c45ff5-0195-418e-bbc2-62bd8dcfc2f0 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.399455 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c45ff5-0195-418e-bbc2-62bd8dcfc2f0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.399782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c45ff5-0195-418e-bbc2-62bd8dcfc2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.406873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34a07-fe89-48b6-9542-19709e6984a1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:25.411934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7b1a0-6974-4392-b9e4-c1a8748675bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:25.412752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7b1a0-6974-4392-b9e4-c1a8748675bc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.413214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7b1a0-6974-4392-b9e4-c1a8748675bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.414063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7b1a0-6974-4392-b9e4-c1a8748675bc admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.415070 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7b1a0-6974-4392-b9e4-c1a8748675bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:25.416724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7b1a0-6974-4392-b9e4-c1a8748675bc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:25.421203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-19c45ff5-0195-418e-bbc2-62bd8dcfc2f0 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:25.422572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-19c45ff5-0195-418e-bbc2-62bd8dcfc2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:25.423779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 496/996] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:37:25 2022] GET /identity/v3/services => generated 1727 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:37:25.436793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 501/997] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:25 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:25.463120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7b1a0-6974-4392-b9e4-c1a8748675bc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:25.474435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7b1a0-6974-4392-b9e4-c1a8748675bc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:25.479658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:25.480602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.481039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.481465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.482391 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:25.484588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:25.486153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.common [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jan 27 16:37:25.505084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.sql.core [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jan 27 16:37:25.505084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jan 27 16:37:25.505084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [parameters: {'user_id': '546aa96cdec846dfb8996b852e45caf0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jan 27 16:37:25.505084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=90785) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jan 27 16:37:25.511005 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jan 27 16:37:25.512680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 497/998] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:37:25 2022] POST /identity/v3/users => generated 160 bytes in 50 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:25.519358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c45ff5-0195-418e-bbc2-62bd8dcfc2f0 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:25.528884 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c45ff5-0195-418e-bbc2-62bd8dcfc2f0 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:25.534587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a11cf-8c59-4dc9-bf02-90bfd101ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:25.535682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a11cf-8c59-4dc9-bf02-90bfd101ada3 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.536006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a11cf-8c59-4dc9-bf02-90bfd101ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.536252 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a11cf-8c59-4dc9-bf02-90bfd101ada3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.545208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a11cf-8c59-4dc9-bf02-90bfd101ada3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:25.547502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a11cf-8c59-4dc9-bf02-90bfd101ada3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:25.565226 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-702a11cf-8c59-4dc9-bf02-90bfd101ada3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jan 27 16:37:25.566893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 502/999] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:25.573168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:25.585767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d97e11-8d2e-4994-a395-f86c14139624 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:25.590620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb28008-c509-4a61-b050-2f696ec67e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:25.591351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb28008-c509-4a61-b050-2f696ec67e15 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.591663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb28008-c509-4a61-b050-2f696ec67e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.592089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb28008-c509-4a61-b050-2f696ec67e15 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.592989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb28008-c509-4a61-b050-2f696ec67e15 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:25.593403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb28008-c509-4a61-b050-2f696ec67e15 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:25.595510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb28008-c509-4a61-b050-2f696ec67e15 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:25.636370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 498/1000] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jan 27 16:37:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:25.912694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15859211-fdef-4869-baae-ab5fc6b86928 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.913082 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15859211-fdef-4869-baae-ab5fc6b86928 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.913264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15859211-fdef-4869-baae-ab5fc6b86928 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.915085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 503/1001] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:25.921173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8733139-9cf6-4430-9b7f-a9215934f1ae None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.921629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8733139-9cf6-4430-9b7f-a9215934f1ae None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.921914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8733139-9cf6-4430-9b7f-a9215934f1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.941324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e8733139-9cf6-4430-9b7f-a9215934f1ae None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:25.942813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e8733139-9cf6-4430-9b7f-a9215934f1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:25.950578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 499/1002] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:25 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:25.973642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15859211-fdef-4869-baae-ab5fc6b86928 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:25.986803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15859211-fdef-4869-baae-ab5fc6b86928 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:25.991468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9011a7c-b9d4-464b-acb8-601267574b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:25.992173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9011a7c-b9d4-464b-acb8-601267574b15 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:25.992457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9011a7c-b9d4-464b-acb8-601267574b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:25.992736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9011a7c-b9d4-464b-acb8-601267574b15 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:25.993483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9011a7c-b9d4-464b-acb8-601267574b15 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:25.995196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9011a7c-b9d4-464b-acb8-601267574b15 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:26.011031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 504/1003] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:37:25 2022] POST /identity/v3/services => generated 242 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:26.079400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307814-1955-4478-9fec-ee150efca305 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:26.079760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307814-1955-4478-9fec-ee150efca305 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:26.080014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6307814-1955-4478-9fec-ee150efca305 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:26.081987 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 500/1004] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:26.087585 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578417-8d55-4d67-8722-0c3a14dcd5da None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:26.087888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578417-8d55-4d67-8722-0c3a14dcd5da None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:26.088160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578417-8d55-4d67-8722-0c3a14dcd5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:26.106628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-94578417-8d55-4d67-8722-0c3a14dcd5da None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:26.108407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-94578417-8d55-4d67-8722-0c3a14dcd5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:26.126670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 505/1005] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:26 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:26.150439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307814-1955-4478-9fec-ee150efca305 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:26.163810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6307814-1955-4478-9fec-ee150efca305 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:26.168513 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44c1dd-eec3-4d6f-92b9-2e768985daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:26.169310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44c1dd-eec3-4d6f-92b9-2e768985daf0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:26.169585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44c1dd-eec3-4d6f-92b9-2e768985daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:26.169856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44c1dd-eec3-4d6f-92b9-2e768985daf0 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:26.171432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44c1dd-eec3-4d6f-92b9-2e768985daf0 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:26.172827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44c1dd-eec3-4d6f-92b9-2e768985daf0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:26.185605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-8f44c1dd-eec3-4d6f-92b9-2e768985daf0 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jan 27 16:37:26.187668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 501/1006] 10.222.0.48 () {56 vars in 1147 bytes} [Thu Jan 27 16:37:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:26.193500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578417-8d55-4d67-8722-0c3a14dcd5da None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:26.203315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578417-8d55-4d67-8722-0c3a14dcd5da None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:26.208745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257344a-df81-494e-9b5a-7cc5a8069d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:26.209679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257344a-df81-494e-9b5a-7cc5a8069d98 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:26.210161 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257344a-df81-494e-9b5a-7cc5a8069d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:26.210636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257344a-df81-494e-9b5a-7cc5a8069d98 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:26.211597 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257344a-df81-494e-9b5a-7cc5a8069d98 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:26.211999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257344a-df81-494e-9b5a-7cc5a8069d98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:26.213765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257344a-df81-494e-9b5a-7cc5a8069d98 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:26.219425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 506/1007] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:26.225214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44c1dd-eec3-4d6f-92b9-2e768985daf0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:26.235694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44c1dd-eec3-4d6f-92b9-2e768985daf0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:26.240393 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8707f70-71a1-45e1-aa98-98b5243d712d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:26.241215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707f70-71a1-45e1-aa98-98b5243d712d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:26.241666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707f70-71a1-45e1-aa98-98b5243d712d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:26.242096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8707f70-71a1-45e1-aa98-98b5243d712d admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:26.242974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8707f70-71a1-45e1-aa98-98b5243d712d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:26.243446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8707f70-71a1-45e1-aa98-98b5243d712d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:26.245235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8707f70-71a1-45e1-aa98-98b5243d712d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:26.251338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 502/1008] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jan 27 16:37:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:26.257108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257344a-df81-494e-9b5a-7cc5a8069d98 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:26.267449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257344a-df81-494e-9b5a-7cc5a8069d98 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:26.271989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6fdaf-0b44-4bb7-b153-41cb16fca4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:26.272758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6fdaf-0b44-4bb7-b153-41cb16fca4db admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:26.273167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6fdaf-0b44-4bb7-b153-41cb16fca4db admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:26.273536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6fdaf-0b44-4bb7-b153-41cb16fca4db admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:26.274392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6fdaf-0b44-4bb7-b153-41cb16fca4db admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:26.276113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6fdaf-0b44-4bb7-b153-41cb16fca4db admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:26.295303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 507/1009] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jan 27 16:37:26 2022] POST /identity/v3/endpoints => generated 325 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:27.757241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500d1d-156a-4694-b108-913a81ea25e2 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:27.757792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500d1d-156a-4694-b108-913a81ea25e2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:27.757792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500d1d-156a-4694-b108-913a81ea25e2 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:27.759763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 503/1010] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:27.764860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e616bb-e5fe-4069-a883-8459685ee2d4 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:27.765282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e616bb-e5fe-4069-a883-8459685ee2d4 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:27.765424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e616bb-e5fe-4069-a883-8459685ee2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:27.783867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-a9e616bb-e5fe-4069-a883-8459685ee2d4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:27.785310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a9e616bb-e5fe-4069-a883-8459685ee2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:27.803683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 508/1011] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:27 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:27.825358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500d1d-156a-4694-b108-913a81ea25e2 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:27.837755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500d1d-156a-4694-b108-913a81ea25e2 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:27.842847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d312a1-b0c1-44a1-bd3d-c880781b9a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:27.843659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d312a1-b0c1-44a1-bd3d-c880781b9a60 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:27.843946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d312a1-b0c1-44a1-bd3d-c880781b9a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:27.844223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d312a1-b0c1-44a1-bd3d-c880781b9a60 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:27.844883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d312a1-b0c1-44a1-bd3d-c880781b9a60 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:27.846472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d312a1-b0c1-44a1-bd3d-c880781b9a60 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:27.857409 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-32d312a1-b0c1-44a1-bd3d-c880781b9a60 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jan 27 16:37:27.859611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 504/1012] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:27.865484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e616bb-e5fe-4069-a883-8459685ee2d4 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:27.874559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e616bb-e5fe-4069-a883-8459685ee2d4 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:27.879087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a7a95-2ced-453c-b4ff-382599f8cf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:27.879850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a7a95-2ced-453c-b4ff-382599f8cf60 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:27.880198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a7a95-2ced-453c-b4ff-382599f8cf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:27.880542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a7a95-2ced-453c-b4ff-382599f8cf60 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:27.881270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a7a95-2ced-453c-b4ff-382599f8cf60 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:27.881574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a7a95-2ced-453c-b4ff-382599f8cf60 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:27.883152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a7a95-2ced-453c-b4ff-382599f8cf60 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:27.888339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 509/1013] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:27.894422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d312a1-b0c1-44a1-bd3d-c880781b9a60 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:27.903851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d312a1-b0c1-44a1-bd3d-c880781b9a60 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:27.909048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f79293-5f27-40a8-88ae-cae7206f599f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:27.909696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f79293-5f27-40a8-88ae-cae7206f599f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:27.910223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f79293-5f27-40a8-88ae-cae7206f599f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:27.910496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f79293-5f27-40a8-88ae-cae7206f599f admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:27.911207 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f79293-5f27-40a8-88ae-cae7206f599f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:27.911509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f79293-5f27-40a8-88ae-cae7206f599f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:27.913100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f79293-5f27-40a8-88ae-cae7206f599f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:28.035605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 505/1014] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jan 27 16:37:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:28.041775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a7a95-2ced-453c-b4ff-382599f8cf60 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:28.051908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a7a95-2ced-453c-b4ff-382599f8cf60 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:28.056382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30701c6-fcc4-48fb-97e5-d2f1e56cef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:28.056973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30701c6-fcc4-48fb-97e5-d2f1e56cef09 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.057251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30701c6-fcc4-48fb-97e5-d2f1e56cef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.057527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30701c6-fcc4-48fb-97e5-d2f1e56cef09 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.058277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30701c6-fcc4-48fb-97e5-d2f1e56cef09 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:28.059919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30701c6-fcc4-48fb-97e5-d2f1e56cef09 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:28.081723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 510/1015] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jan 27 16:37:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:37:28.273141 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df8e7e-5cf4-4ddc-8001-3ccd8b3641a9 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.273572 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df8e7e-5cf4-4ddc-8001-3ccd8b3641a9 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.273956 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df8e7e-5cf4-4ddc-8001-3ccd8b3641a9 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.276110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 506/1016] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:28.282052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2d51f-5b72-4d8b-8491-fbf94ead8436 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.282364 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2d51f-5b72-4d8b-8491-fbf94ead8436 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.282667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2d51f-5b72-4d8b-8491-fbf94ead8436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.301914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-0ef2d51f-5b72-4d8b-8491-fbf94ead8436 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:28.303143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0ef2d51f-5b72-4d8b-8491-fbf94ead8436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:28.322413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 511/1017] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:28 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:28.346342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df8e7e-5cf4-4ddc-8001-3ccd8b3641a9 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:28.360190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df8e7e-5cf4-4ddc-8001-3ccd8b3641a9 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:28.364929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ac38-124a-4285-a7cf-6f984c94af30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:28.365817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ac38-124a-4285-a7cf-6f984c94af30 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.366193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ac38-124a-4285-a7cf-6f984c94af30 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.366475 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ac38-124a-4285-a7cf-6f984c94af30 admin admin] PATH_INFO: `/v3/services/image` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.367142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ac38-124a-4285-a7cf-6f984c94af30 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:28.368798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ac38-124a-4285-a7cf-6f984c94af30 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:28.381598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-bbd7ac38-124a-4285-a7cf-6f984c94af30 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 27 16:37:28.382948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 507/1018] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jan 27 16:37:28 2022] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:28.389281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2d51f-5b72-4d8b-8491-fbf94ead8436 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:28.399149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2d51f-5b72-4d8b-8491-fbf94ead8436 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:28.403669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f743c-52b6-49f1-9ca1-20a53da5713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:28.404431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f743c-52b6-49f1-9ca1-20a53da5713b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.405530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f743c-52b6-49f1-9ca1-20a53da5713b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.405895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f743c-52b6-49f1-9ca1-20a53da5713b admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.406634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f743c-52b6-49f1-9ca1-20a53da5713b admin admin] RBAC: Adding query filter params (name=image) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:28.406945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f743c-52b6-49f1-9ca1-20a53da5713b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:28.408556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f743c-52b6-49f1-9ca1-20a53da5713b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:28.414136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 512/1019] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:28.419516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ac38-124a-4285-a7cf-6f984c94af30 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:28.430222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ac38-124a-4285-a7cf-6f984c94af30 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:28.434582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f796b5-c5ff-45a6-903f-d0cb0985568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:28.435226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f796b5-c5ff-45a6-903f-d0cb0985568e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.435505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f796b5-c5ff-45a6-903f-d0cb0985568e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.436962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f796b5-c5ff-45a6-903f-d0cb0985568e admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.437650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f796b5-c5ff-45a6-903f-d0cb0985568e admin admin] RBAC: Adding query filter params (type=image) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:28.437957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f796b5-c5ff-45a6-903f-d0cb0985568e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:28.439535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f796b5-c5ff-45a6-903f-d0cb0985568e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:28.444752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 508/1020] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:28.450318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f743c-52b6-49f1-9ca1-20a53da5713b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:28.460087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f743c-52b6-49f1-9ca1-20a53da5713b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:28.464596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433e1a1-3845-4d63-bb1c-084886f6c201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:28.465374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e1a1-3845-4d63-bb1c-084886f6c201 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.465743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e1a1-3845-4d63-bb1c-084886f6c201 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.466113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433e1a1-3845-4d63-bb1c-084886f6c201 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.467016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433e1a1-3845-4d63-bb1c-084886f6c201 admin admin] RBAC: Adding query filter params (interface=public, service_id=1b0ddb90a7c74097bc741194782e1100, region_id=RegionOne) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:28.467725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433e1a1-3845-4d63-bb1c-084886f6c201 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:28.469140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433e1a1-3845-4d63-bb1c-084886f6c201 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:28.474523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 513/1021] 10.222.0.48 () {56 vars in 1272 bytes} [Thu Jan 27 16:37:28 2022] GET /identity/v3/endpoints?service_id=1b0ddb90a7c74097bc741194782e1100&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:28.480159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f796b5-c5ff-45a6-903f-d0cb0985568e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:28.491162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f796b5-c5ff-45a6-903f-d0cb0985568e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:28.495834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2f2f1-63a9-4172-887a-c4ca6f7dd5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:28.496492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2f2f1-63a9-4172-887a-c4ca6f7dd5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.496772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2f2f1-63a9-4172-887a-c4ca6f7dd5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.497049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2f2f1-63a9-4172-887a-c4ca6f7dd5f2 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.497741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2f2f1-63a9-4172-887a-c4ca6f7dd5f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:28.500591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2f2f1-63a9-4172-887a-c4ca6f7dd5f2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:28.507658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 509/1022] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:37:28 2022] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:37:28.555352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e14b9e-2c45-4d07-ac81-ed472163d741 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.555701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e14b9e-2c45-4d07-ac81-ed472163d741 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.555953 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e14b9e-2c45-4d07-ac81-ed472163d741 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.557906 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 514/1023] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:28.564280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15a6b-452f-4641-b6d4-df0a47143a4b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.564580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15a6b-452f-4641-b6d4-df0a47143a4b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.564803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb15a6b-452f-4641-b6d4-df0a47143a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.584202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-8bb15a6b-452f-4641-b6d4-df0a47143a4b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:28.585342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8bb15a6b-452f-4641-b6d4-df0a47143a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:28.593938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 510/1024] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:28 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:28.618792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e14b9e-2c45-4d07-ac81-ed472163d741 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:28.631920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e14b9e-2c45-4d07-ac81-ed472163d741 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:28.636517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3785f0a-8fc8-4ff7-802a-ec6bfe66e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:28.637438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3785f0a-8fc8-4ff7-802a-ec6bfe66e391 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.637822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3785f0a-8fc8-4ff7-802a-ec6bfe66e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.638192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3785f0a-8fc8-4ff7-802a-ec6bfe66e391 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.640349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3785f0a-8fc8-4ff7-802a-ec6bfe66e391 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:28.642174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3785f0a-8fc8-4ff7-802a-ec6bfe66e391 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:28.644208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 515/1025] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:28.649817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb15a6b-452f-4641-b6d4-df0a47143a4b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:28.659778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb15a6b-452f-4641-b6d4-df0a47143a4b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:28.664760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbab353-3761-49a2-8ffa-a632238cfb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:28.665546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab353-3761-49a2-8ffa-a632238cfb3f admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:28.665928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab353-3761-49a2-8ffa-a632238cfb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:28.666299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab353-3761-49a2-8ffa-a632238cfb3f admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:28.667146 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbab353-3761-49a2-8ffa-a632238cfb3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:28.669194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbab353-3761-49a2-8ffa-a632238cfb3f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:28.698668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 511/1026] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:37:28 2022] POST /identity/v3/projects => generated 311 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:37:30.553351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386aa38-5bac-4b8e-ba6b-45a4ef83cf41 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.553807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386aa38-5bac-4b8e-ba6b-45a4ef83cf41 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.553997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386aa38-5bac-4b8e-ba6b-45a4ef83cf41 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.555814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 516/1027] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:30.561602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b2052-1fb8-4cc5-bf0a-58f88269913a None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.562129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b2052-1fb8-4cc5-bf0a-58f88269913a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.562129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b2052-1fb8-4cc5-bf0a-58f88269913a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.579498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-512b2052-1fb8-4cc5-bf0a-58f88269913a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:30.580698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-512b2052-1fb8-4cc5-bf0a-58f88269913a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:30.636840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 512/1028] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:30 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:30.661796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386aa38-5bac-4b8e-ba6b-45a4ef83cf41 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.674210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386aa38-5bac-4b8e-ba6b-45a4ef83cf41 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.678582 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248805-0fb8-49be-a978-7052f1d5c1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.679388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248805-0fb8-49be-a978-7052f1d5c1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.679695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248805-0fb8-49be-a978-7052f1d5c1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.679972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248805-0fb8-49be-a978-7052f1d5c1f2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.690024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e248805-0fb8-49be-a978-7052f1d5c1f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:30.697328 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-3e248805-0fb8-49be-a978-7052f1d5c1f2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 27 16:37:30.698715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 517/1029] 10.222.0.48 () {56 vars in 1141 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:30.704916 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b2052-1fb8-4cc5-bf0a-58f88269913a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.713874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b2052-1fb8-4cc5-bf0a-58f88269913a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.719063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc517d-59dd-447c-9d7d-aabde1df0c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.719832 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc517d-59dd-447c-9d7d-aabde1df0c02 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.720183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc517d-59dd-447c-9d7d-aabde1df0c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.720527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc517d-59dd-447c-9d7d-aabde1df0c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.721292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc517d-59dd-447c-9d7d-aabde1df0c02 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:30.721597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc517d-59dd-447c-9d7d-aabde1df0c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.723182 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc517d-59dd-447c-9d7d-aabde1df0c02 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.731822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 513/1030] 10.222.0.48 () {56 vars in 1136 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:30.737664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248805-0fb8-49be-a978-7052f1d5c1f2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.747859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248805-0fb8-49be-a978-7052f1d5c1f2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.752508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495bac-1d44-4fa7-8b14-31e90825ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.753285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495bac-1d44-4fa7-8b14-31e90825ff55 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.753567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495bac-1d44-4fa7-8b14-31e90825ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.753843 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495bac-1d44-4fa7-8b14-31e90825ff55 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.757008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754b957-b357-4f64-abd5-06e0ec32c19c None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.757521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754b957-b357-4f64-abd5-06e0ec32c19c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.758044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754b957-b357-4f64-abd5-06e0ec32c19c None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.760367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 514/1031] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:30.765123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495bac-1d44-4fa7-8b14-31e90825ff55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.766470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584cd83-fc60-4b83-bd71-14f9b21e975e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.766957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584cd83-fc60-4b83-bd71-14f9b21e975e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.767062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495bac-1d44-4fa7-8b14-31e90825ff55 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.767751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584cd83-fc60-4b83-bd71-14f9b21e975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.784449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-b7495bac-1d44-4fa7-8b14-31e90825ff55 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:30.790495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 518/1032] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:30.790622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a584cd83-fc60-4b83-bd71-14f9b21e975e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:30.790622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a584cd83-fc60-4b83-bd71-14f9b21e975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:30.792032 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495bac-1d44-4fa7-8b14-31e90825ff55 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.798073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 515/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:30 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:30.802013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495bac-1d44-4fa7-8b14-31e90825ff55 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.806361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc750b39-ce4c-428f-97a2-cd63f08be651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.807002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc750b39-ce4c-428f-97a2-cd63f08be651 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.807284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc750b39-ce4c-428f-97a2-cd63f08be651 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.807561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc750b39-ce4c-428f-97a2-cd63f08be651 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.808317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc750b39-ce4c-428f-97a2-cd63f08be651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:30.808622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc750b39-ce4c-428f-97a2-cd63f08be651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.810203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc750b39-ce4c-428f-97a2-cd63f08be651 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.821851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584cd83-fc60-4b83-bd71-14f9b21e975e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.826325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 519/1034] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:30.828652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc750b39-ce4c-428f-97a2-cd63f08be651 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.831881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584cd83-fc60-4b83-bd71-14f9b21e975e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.837891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971b87-f3ac-439b-bb0f-9a8ce6ba1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.838611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc750b39-ce4c-428f-97a2-cd63f08be651 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.838833 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971b87-f3ac-439b-bb0f-9a8ce6ba1198 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.839155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971b87-f3ac-439b-bb0f-9a8ce6ba1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.839601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971b87-f3ac-439b-bb0f-9a8ce6ba1198 admin admin] PATH_INFO: `/v3/services/image` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.840388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971b87-f3ac-439b-bb0f-9a8ce6ba1198 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.842306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971b87-f3ac-439b-bb0f-9a8ce6ba1198 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.844231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9047b5d-7fdd-48f0-bb8c-33605e63927d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.845052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047b5d-7fdd-48f0-bb8c-33605e63927d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.845335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047b5d-7fdd-48f0-bb8c-33605e63927d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.845611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9047b5d-7fdd-48f0-bb8c-33605e63927d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.854176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047b5d-7fdd-48f0-bb8c-33605e63927d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.854576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-56971b87-f3ac-439b-bb0f-9a8ce6ba1198 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jan 27 16:37:30.856289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9047b5d-7fdd-48f0-bb8c-33605e63927d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.859792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 516/1035] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/services/image => generated 86 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:30.862503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971b87-f3ac-439b-bb0f-9a8ce6ba1198 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.871478 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-f9047b5d-7fdd-48f0-bb8c-33605e63927d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 27 16:37:30.872340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971b87-f3ac-439b-bb0f-9a8ce6ba1198 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.872878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 520/1036] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:30.877556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a7f4-535f-4a98-9636-6429a9d37c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.878249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a7f4-535f-4a98-9636-6429a9d37c8b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.878532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a7f4-535f-4a98-9636-6429a9d37c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.878811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a7f4-535f-4a98-9636-6429a9d37c8b admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.879309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9047b5d-7fdd-48f0-bb8c-33605e63927d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.879537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a7f4-535f-4a98-9636-6429a9d37c8b admin admin] RBAC: Adding query filter params (name=image) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:30.879866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a7f4-535f-4a98-9636-6429a9d37c8b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.881464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a7f4-535f-4a98-9636-6429a9d37c8b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.886583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 517/1037] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:30.889844 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9047b5d-7fdd-48f0-bb8c-33605e63927d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.892661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a7f4-535f-4a98-9636-6429a9d37c8b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.894667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c4a6d-340b-4f10-89e3-e835fb5a3668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.895309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4a6d-340b-4f10-89e3-e835fb5a3668 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.895609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4a6d-340b-4f10-89e3-e835fb5a3668 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.895890 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4a6d-340b-4f10-89e3-e835fb5a3668 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.896729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c4a6d-340b-4f10-89e3-e835fb5a3668 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:30.897035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c4a6d-340b-4f10-89e3-e835fb5a3668 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.898853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c4a6d-340b-4f10-89e3-e835fb5a3668 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.901940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a7f4-535f-4a98-9636-6429a9d37c8b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.906405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2ec1e-fddf-416e-ada9-47d28ae1e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.907044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2ec1e-fddf-416e-ada9-47d28ae1e313 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.907328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2ec1e-fddf-416e-ada9-47d28ae1e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.907622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f2ec1e-fddf-416e-ada9-47d28ae1e313 admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.908326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2ec1e-fddf-416e-ada9-47d28ae1e313 admin admin] RBAC: Adding query filter params (type=image) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:30.908629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2ec1e-fddf-416e-ada9-47d28ae1e313 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.910447 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f2ec1e-fddf-416e-ada9-47d28ae1e313 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.921577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 521/1038] 10.222.0.48 () {56 vars in 1154 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:30.921764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 518/1039] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:30.921860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c4a6d-340b-4f10-89e3-e835fb5a3668 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.922398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2ec1e-fddf-416e-ada9-47d28ae1e313 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.931656 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c4a6d-340b-4f10-89e3-e835fb5a3668 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.932040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f2ec1e-fddf-416e-ada9-47d28ae1e313 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.936807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feee2c9-2848-487e-afab-1ae8142e8216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.937367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e3a41-466c-4a5d-a54d-3907ba0dafc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.937575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feee2c9-2848-487e-afab-1ae8142e8216 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.937821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feee2c9-2848-487e-afab-1ae8142e8216 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.937990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e3a41-466c-4a5d-a54d-3907ba0dafc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.938095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feee2c9-2848-487e-afab-1ae8142e8216 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.938276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e3a41-466c-4a5d-a54d-3907ba0dafc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.938555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e3a41-466c-4a5d-a54d-3907ba0dafc6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:30.938824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feee2c9-2848-487e-afab-1ae8142e8216 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.940424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feee2c9-2848-487e-afab-1ae8142e8216 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.946460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e3a41-466c-4a5d-a54d-3907ba0dafc6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:30.948228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e3a41-466c-4a5d-a54d-3907ba0dafc6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:30.958710 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 519/1040] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:30.963605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 522/1041] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jan 27 16:37:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:30.964628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e3a41-466c-4a5d-a54d-3907ba0dafc6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:30.973907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e3a41-466c-4a5d-a54d-3907ba0dafc6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:30.992539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead913d-1755-4fb7-82cf-e0eb8b5e5c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:30.993338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead913d-1755-4fb7-82cf-e0eb8b5e5c1f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:30.993617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead913d-1755-4fb7-82cf-e0eb8b5e5c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:30.993888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead913d-1755-4fb7-82cf-e0eb8b5e5c1f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:31.005727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead913d-1755-4fb7-82cf-e0eb8b5e5c1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:31.007597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead913d-1755-4fb7-82cf-e0eb8b5e5c1f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:31.026328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-0ead913d-1755-4fb7-82cf-e0eb8b5e5c1f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:31.027807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 520/1042] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:31.034167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feee2c9-2848-487e-afab-1ae8142e8216 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:31.046337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feee2c9-2848-487e-afab-1ae8142e8216 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:31.051432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be16619-ea7d-4d8a-9640-d7824fc8b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:31.052231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16619-ea7d-4d8a-9640-d7824fc8b9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:31.052595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16619-ea7d-4d8a-9640-d7824fc8b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:31.052966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be16619-ea7d-4d8a-9640-d7824fc8b9a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:31.053866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16619-ea7d-4d8a-9640-d7824fc8b9a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:31.054249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16619-ea7d-4d8a-9640-d7824fc8b9a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:31.056028 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be16619-ea7d-4d8a-9640-d7824fc8b9a9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:31.074562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 523/1043] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:31.075980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead913d-1755-4fb7-82cf-e0eb8b5e5c1f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:31.086874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead913d-1755-4fb7-82cf-e0eb8b5e5c1f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:31.091531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fab17-f788-4fbf-96b9-04d1c7327ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:31.092943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fab17-f788-4fbf-96b9-04d1c7327ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:31.093310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fab17-f788-4fbf-96b9-04d1c7327ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:31.093590 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fab17-f788-4fbf-96b9-04d1c7327ca4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:31.097784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ba770-5dfa-4e27-9808-712757e91e89 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:31.098077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ba770-5dfa-4e27-9808-712757e91e89 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:31.098357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ba770-5dfa-4e27-9808-712757e91e89 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:31.100401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 524/1044] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:31.104936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fab17-f788-4fbf-96b9-04d1c7327ca4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:31.105702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b51967-5d6b-4e44-b2c7-f081d467473f None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:31.105996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b51967-5d6b-4e44-b2c7-f081d467473f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:31.106275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b51967-5d6b-4e44-b2c7-f081d467473f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:31.106917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fab17-f788-4fbf-96b9-04d1c7327ca4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:31.122235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-226fab17-f788-4fbf-96b9-04d1c7327ca4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:31.124021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 521/1045] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:31.126234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-22b51967-5d6b-4e44-b2c7-f081d467473f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:31.127448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-22b51967-5d6b-4e44-b2c7-f081d467473f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:31.129641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fab17-f788-4fbf-96b9-04d1c7327ca4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:31.135853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 525/1046] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:31.139508 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fab17-f788-4fbf-96b9-04d1c7327ca4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:31.144371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b9a36-4885-4947-9ee8-b3811638a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:31.145022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9a36-4885-4947-9ee8-b3811638a8bb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:31.145306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9a36-4885-4947-9ee8-b3811638a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:31.145584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b9a36-4885-4947-9ee8-b3811638a8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:31.146380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9a36-4885-4947-9ee8-b3811638a8bb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:31.146692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9a36-4885-4947-9ee8-b3811638a8bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:31.148559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1b9a36-4885-4947-9ee8-b3811638a8bb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:31.162043 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b51967-5d6b-4e44-b2c7-f081d467473f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:31.162439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 522/1047] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:31.168587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b9a36-4885-4947-9ee8-b3811638a8bb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:31.172961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b51967-5d6b-4e44-b2c7-f081d467473f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:31.178490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871997d-882b-461f-aac7-7fff2c586461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:31.178992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b9a36-4885-4947-9ee8-b3811638a8bb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:31.179287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871997d-882b-461f-aac7-7fff2c586461 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:31.179636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871997d-882b-461f-aac7-7fff2c586461 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:31.179896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871997d-882b-461f-aac7-7fff2c586461 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:31.181078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871997d-882b-461f-aac7-7fff2c586461 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:31.182763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871997d-882b-461f-aac7-7fff2c586461 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:31.183784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c15db-5896-436e-8b0b-136ecded6ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:31.184580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 526/1048] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:31.184709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c15db-5896-436e-8b0b-136ecded6ced admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:31.184878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c15db-5896-436e-8b0b-136ecded6ced admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:31.185125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c15db-5896-436e-8b0b-136ecded6ced admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:31.186227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c15db-5896-436e-8b0b-136ecded6ced admin admin] RBAC: Adding query filter params (role.id=6dc9a8ecd98b4fab8314890bf5b2bad9, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=8500a8d242bf43a9b2fd538c3b1bb037) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:31.186538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c15db-5896-436e-8b0b-136ecded6ced admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:31.188526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c15db-5896-436e-8b0b-136ecded6ced admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:31.190073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871997d-882b-461f-aac7-7fff2c586461 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:31.195662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 523/1049] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:31 2022] GET /identity/v3/role_assignments?user.id=8500a8d242bf43a9b2fd538c3b1bb037&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=6dc9a8ecd98b4fab8314890bf5b2bad9 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:31.200818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871997d-882b-461f-aac7-7fff2c586461 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:31.206198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf70ed5-ad5c-4350-8960-18a4d2aa2c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:31.206896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70ed5-ad5c-4350-8960-18a4d2aa2c3d admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:31.207179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70ed5-ad5c-4350-8960-18a4d2aa2c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:31.207457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf70ed5-ad5c-4350-8960-18a4d2aa2c3d admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:31.208276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf70ed5-ad5c-4350-8960-18a4d2aa2c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:31.210253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf70ed5-ad5c-4350-8960-18a4d2aa2c3d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:31.232697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 527/1050] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:37:31 2022] POST /identity/v3/users => generated 285 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:37:33.238261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb273485-5dac-4fb7-91b9-2dfa6a6e905c None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.238789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb273485-5dac-4fb7-91b9-2dfa6a6e905c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.238869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb273485-5dac-4fb7-91b9-2dfa6a6e905c None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.240790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 524/1051] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:33.246022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df654bf-bd56-4774-b65e-a46d729d53cf None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.246448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df654bf-bd56-4774-b65e-a46d729d53cf None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.246769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df654bf-bd56-4774-b65e-a46d729d53cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.266070 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2df654bf-bd56-4774-b65e-a46d729d53cf None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:33.267453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2df654bf-bd56-4774-b65e-a46d729d53cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:33.275847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 528/1052] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:33.300287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb273485-5dac-4fb7-91b9-2dfa6a6e905c None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.313121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb273485-5dac-4fb7-91b9-2dfa6a6e905c None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.317445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81d3e5-1448-4587-b37b-569df6bcc06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.318087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81d3e5-1448-4587-b37b-569df6bcc06d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.318375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81d3e5-1448-4587-b37b-569df6bcc06d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.318658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81d3e5-1448-4587-b37b-569df6bcc06d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.326406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81d3e5-1448-4587-b37b-569df6bcc06d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.328910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81d3e5-1448-4587-b37b-569df6bcc06d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.338137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 525/1053] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:33.344592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df654bf-bd56-4774-b65e-a46d729d53cf None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.353618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df654bf-bd56-4774-b65e-a46d729d53cf None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.358874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c867e-b579-49ed-a68d-2f9b8a462b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.359812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c867e-b579-49ed-a68d-2f9b8a462b70 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.360198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c867e-b579-49ed-a68d-2f9b8a462b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.360594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c867e-b579-49ed-a68d-2f9b8a462b70 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.361912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c867e-b579-49ed-a68d-2f9b8a462b70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.363750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c867e-b579-49ed-a68d-2f9b8a462b70 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.365580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 529/1054] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:33.420116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568a03-c312-42be-a711-0410c3f9655b None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.421017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568a03-c312-42be-a711-0410c3f9655b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.421252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568a03-c312-42be-a711-0410c3f9655b None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.423297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 526/1055] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:33.429031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f426d-e7d7-4780-b8a5-8afeca4ff14e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.429323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f426d-e7d7-4780-b8a5-8afeca4ff14e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.429593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f426d-e7d7-4780-b8a5-8afeca4ff14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.447993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-935f426d-e7d7-4780-b8a5-8afeca4ff14e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:33.449195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-935f426d-e7d7-4780-b8a5-8afeca4ff14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:33.457801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 530/1056] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:33.480771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568a03-c312-42be-a711-0410c3f9655b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.494170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568a03-c312-42be-a711-0410c3f9655b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.503598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ee705-a8f3-4129-a07a-172340d27489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.504430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ee705-a8f3-4129-a07a-172340d27489 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.504713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ee705-a8f3-4129-a07a-172340d27489 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.504990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ee705-a8f3-4129-a07a-172340d27489 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.517594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ee705-a8f3-4129-a07a-172340d27489 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:33.525116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-0a8ee705-a8f3-4129-a07a-172340d27489 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 27 16:37:33.526241 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d533-336b-43ed-ae0a-90d2798f460e None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.526532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d533-336b-43ed-ae0a-90d2798f460e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.526817 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358d533-336b-43ed-ae0a-90d2798f460e None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.527150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 527/1057] 10.222.0.48 () {56 vars in 1141 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:33.529459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 531/1058] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:33.534719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ee705-a8f3-4129-a07a-172340d27489 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.536435 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359b5f7-bda0-46f8-b193-aa67c960bbe9 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.536728 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359b5f7-bda0-46f8-b193-aa67c960bbe9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.537011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359b5f7-bda0-46f8-b193-aa67c960bbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.544619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ee705-a8f3-4129-a07a-172340d27489 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.549750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e832e7-0925-4617-94c8-88c8d1eb6b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.550418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e832e7-0925-4617-94c8-88c8d1eb6b84 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.551894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e832e7-0925-4617-94c8-88c8d1eb6b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.551894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e832e7-0925-4617-94c8-88c8d1eb6b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.551894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e832e7-0925-4617-94c8-88c8d1eb6b84 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:33.552151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e832e7-0925-4617-94c8-88c8d1eb6b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.553718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e832e7-0925-4617-94c8-88c8d1eb6b84 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.556274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8359b5f7-bda0-46f8-b193-aa67c960bbe9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:33.557581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8359b5f7-bda0-46f8-b193-aa67c960bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:33.564792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 528/1059] 10.222.0.48 () {56 vars in 1136 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:33.566709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 532/1060] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:33.570393 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e832e7-0925-4617-94c8-88c8d1eb6b84 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.580569 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e832e7-0925-4617-94c8-88c8d1eb6b84 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.585228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b8ad9-b524-4c03-a3da-0df9ff4be492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.586009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b8ad9-b524-4c03-a3da-0df9ff4be492 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.586297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b8ad9-b524-4c03-a3da-0df9ff4be492 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.586582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b8ad9-b524-4c03-a3da-0df9ff4be492 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.591170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359b5f7-bda0-46f8-b193-aa67c960bbe9 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.597489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b8ad9-b524-4c03-a3da-0df9ff4be492 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.599340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b8ad9-b524-4c03-a3da-0df9ff4be492 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.600979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359b5f7-bda0-46f8-b193-aa67c960bbe9 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.607004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ae21b-de55-4f48-bbbb-a2335ad8b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.608432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ae21b-de55-4f48-bbbb-a2335ad8b62b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.608840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ae21b-de55-4f48-bbbb-a2335ad8b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.609039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ae21b-de55-4f48-bbbb-a2335ad8b62b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.618325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-3c5b8ad9-b524-4c03-a3da-0df9ff4be492 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:33.619786 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ae21b-de55-4f48-bbbb-a2335ad8b62b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:33.619903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 529/1061] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:33.625246 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b8ad9-b524-4c03-a3da-0df9ff4be492 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.626924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-469ae21b-de55-4f48-bbbb-a2335ad8b62b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:33.628166 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 533/1062] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:33.633987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ae21b-de55-4f48-bbbb-a2335ad8b62b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.635128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b8ad9-b524-4c03-a3da-0df9ff4be492 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.640270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318076-de90-49d1-8c49-c8039300a623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.640966 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318076-de90-49d1-8c49-c8039300a623 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.641191 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318076-de90-49d1-8c49-c8039300a623 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.641464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef318076-de90-49d1-8c49-c8039300a623 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.642195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef318076-de90-49d1-8c49-c8039300a623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:33.642497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef318076-de90-49d1-8c49-c8039300a623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.644124 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef318076-de90-49d1-8c49-c8039300a623 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.645409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ae21b-de55-4f48-bbbb-a2335ad8b62b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.651838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f624b-dd0f-41b7-9d8c-34ed0a1f0fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.652975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f624b-dd0f-41b7-9d8c-34ed0a1f0fab admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.653263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f624b-dd0f-41b7-9d8c-34ed0a1f0fab admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.653542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f624b-dd0f-41b7-9d8c-34ed0a1f0fab admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.654940 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f624b-dd0f-41b7-9d8c-34ed0a1f0fab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:33.655505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f624b-dd0f-41b7-9d8c-34ed0a1f0fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.657138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f624b-dd0f-41b7-9d8c-34ed0a1f0fab admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.658430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 530/1063] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:33.664540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318076-de90-49d1-8c49-c8039300a623 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.666434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 534/1064] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:33.674170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f624b-dd0f-41b7-9d8c-34ed0a1f0fab admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.675429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef318076-de90-49d1-8c49-c8039300a623 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.680483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6e22-ff1b-4d7f-85ea-034b445245e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.681267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6e22-ff1b-4d7f-85ea-034b445245e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.681676 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6e22-ff1b-4d7f-85ea-034b445245e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.681838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6e22-ff1b-4d7f-85ea-034b445245e2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.684333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f624b-dd0f-41b7-9d8c-34ed0a1f0fab admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.689774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c948176-0901-4a83-9bff-bfaef31faa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.690632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c948176-0901-4a83-9bff-bfaef31faa64 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.690919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c948176-0901-4a83-9bff-bfaef31faa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.691196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c948176-0901-4a83-9bff-bfaef31faa64 admin admin] PATH_INFO: `/v3/users/e12d0623ba954377af00deaee444dedc` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.691302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca6e22-ff1b-4d7f-85ea-034b445245e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.693301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca6e22-ff1b-4d7f-85ea-034b445245e2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.704635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c948176-0901-4a83-9bff-bfaef31faa64 admin admin] RBAC: Authorizing `identity:get_user(user_id=e12d0623ba954377af00deaee444dedc)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.706244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-f7ca6e22-ff1b-4d7f-85ea-034b445245e2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 27 16:37:33.706743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c948176-0901-4a83-9bff-bfaef31faa64 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.707404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 531/1065] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:33.708609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 535/1066] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/users/e12d0623ba954377af00deaee444dedc => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:33.713347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6e22-ff1b-4d7f-85ea-034b445245e2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.713777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c948176-0901-4a83-9bff-bfaef31faa64 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.722895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6e22-ff1b-4d7f-85ea-034b445245e2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.723251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c948176-0901-4a83-9bff-bfaef31faa64 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.727395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef15fd-ea00-490f-bd6b-04a5d4008dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.727743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea65b7-ba8f-4bff-a0e3-a84f285d827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.728073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef15fd-ea00-490f-bd6b-04a5d4008dda admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.728355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef15fd-ea00-490f-bd6b-04a5d4008dda admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.728458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea65b7-ba8f-4bff-a0e3-a84f285d827c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.728631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef15fd-ea00-490f-bd6b-04a5d4008dda admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.728724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea65b7-ba8f-4bff-a0e3-a84f285d827c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.728910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea65b7-ba8f-4bff-a0e3-a84f285d827c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.729469 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef15fd-ea00-490f-bd6b-04a5d4008dda admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:33.729774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef15fd-ea00-490f-bd6b-04a5d4008dda admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.731609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef15fd-ea00-490f-bd6b-04a5d4008dda admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.737257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea65b7-ba8f-4bff-a0e3-a84f285d827c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.738971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea65b7-ba8f-4bff-a0e3-a84f285d827c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.747865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 536/1067] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:37:33.753913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 532/1068] 10.222.0.48 () {56 vars in 1154 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:33.754059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea65b7-ba8f-4bff-a0e3-a84f285d827c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.754818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef15fd-ea00-490f-bd6b-04a5d4008dda admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.762241 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea65b7-ba8f-4bff-a0e3-a84f285d827c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.763692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef15fd-ea00-490f-bd6b-04a5d4008dda admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.767006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad27d-3b79-4007-911a-e79641ff572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.767873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad27d-3b79-4007-911a-e79641ff572b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.768158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad27d-3b79-4007-911a-e79641ff572b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.768309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd9451-7b36-49d6-b4f5-f437af7f3b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.768436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bad27d-3b79-4007-911a-e79641ff572b admin admin] PATH_INFO: `/v3/projects/2f9a395afe664af38f2d9876ab31c456` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.769058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd9451-7b36-49d6-b4f5-f437af7f3b50 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.769336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd9451-7b36-49d6-b4f5-f437af7f3b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.769589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad27d-3b79-4007-911a-e79641ff572b admin admin] RBAC: Authorizing `identity:get_project(project_id=2f9a395afe664af38f2d9876ab31c456)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.769683 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd9451-7b36-49d6-b4f5-f437af7f3b50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.771637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bad27d-3b79-4007-911a-e79641ff572b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.777908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 537/1069] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/projects/2f9a395afe664af38f2d9876ab31c456 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:33.778955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad27d-3b79-4007-911a-e79641ff572b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.780646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd9451-7b36-49d6-b4f5-f437af7f3b50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.782497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd9451-7b36-49d6-b4f5-f437af7f3b50 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.788816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bad27d-3b79-4007-911a-e79641ff572b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.793236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ffa17-cbc4-4fd9-a401-6b9909bfd7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.793836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ffa17-cbc4-4fd9-a401-6b9909bfd7cf admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.794118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ffa17-cbc4-4fd9-a401-6b9909bfd7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.794393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ffa17-cbc4-4fd9-a401-6b9909bfd7cf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.795207 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ffa17-cbc4-4fd9-a401-6b9909bfd7cf admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=2f9a395afe664af38f2d9876ab31c456, user.id=e12d0623ba954377af00deaee444dedc) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:33.796156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ffa17-cbc4-4fd9-a401-6b9909bfd7cf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.797934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ffa17-cbc4-4fd9-a401-6b9909bfd7cf admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.800367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-0fcd9451-7b36-49d6-b4f5-f437af7f3b50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:33.801587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 533/1070] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:33.819599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 538/1071] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/role_assignments?user.id=e12d0623ba954377af00deaee444dedc&scope.project.id=2f9a395afe664af38f2d9876ab31c456&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:33.819841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd9451-7b36-49d6-b4f5-f437af7f3b50 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.819841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd9451-7b36-49d6-b4f5-f437af7f3b50 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.821952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757f827-6216-4fd0-9257-f313ede98f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.822636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757f827-6216-4fd0-9257-f313ede98f0d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.822923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757f827-6216-4fd0-9257-f313ede98f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.823201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757f827-6216-4fd0-9257-f313ede98f0d admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.823991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757f827-6216-4fd0-9257-f313ede98f0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:33.824300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757f827-6216-4fd0-9257-f313ede98f0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.825935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757f827-6216-4fd0-9257-f313ede98f0d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.839660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 534/1072] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:33.845321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ffa17-cbc4-4fd9-a401-6b9909bfd7cf admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.855392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ffa17-cbc4-4fd9-a401-6b9909bfd7cf admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.860790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e0a69-198e-426f-986a-465e096fa3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.861610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e0a69-198e-426f-986a-465e096fa3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.861894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e0a69-198e-426f-986a-465e096fa3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.862170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e0a69-198e-426f-986a-465e096fa3a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.869914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e0a69-198e-426f-986a-465e096fa3a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.871920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e0a69-198e-426f-986a-465e096fa3a9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.887379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-cf8e0a69-198e-426f-986a-465e096fa3a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:33.888648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 539/1073] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:33.895888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757f827-6216-4fd0-9257-f313ede98f0d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.905977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757f827-6216-4fd0-9257-f313ede98f0d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.910906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef6d12-283a-4c9a-b1cc-3c8750173cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.911600 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef6d12-283a-4c9a-b1cc-3c8750173cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.911896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef6d12-283a-4c9a-b1cc-3c8750173cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.912175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef6d12-283a-4c9a-b1cc-3c8750173cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.912988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef6d12-283a-4c9a-b1cc-3c8750173cf3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:33.913298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef6d12-283a-4c9a-b1cc-3c8750173cf3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.915165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ef6d12-283a-4c9a-b1cc-3c8750173cf3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.928848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 535/1074] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:33.934808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e0a69-198e-426f-986a-465e096fa3a9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:33.946010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e0a69-198e-426f-986a-465e096fa3a9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:33.950657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2bcfc9-0448-4326-a759-f8e95ff3b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:33.951948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bcfc9-0448-4326-a759-f8e95ff3b907 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:33.952436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bcfc9-0448-4326-a759-f8e95ff3b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:33.952840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2bcfc9-0448-4326-a759-f8e95ff3b907 admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/8500a8d242bf43a9b2fd538c3b1bb037/roles/6dc9a8ecd98b4fab8314890bf5b2bad9` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:33.955173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bcfc9-0448-4326-a759-f8e95ff3b907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=8500a8d242bf43a9b2fd538c3b1bb037, role_id=6dc9a8ecd98b4fab8314890bf5b2bad9)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:33.957874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2bcfc9-0448-4326-a759-f8e95ff3b907 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:33.972008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 540/1075] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:37:33 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/8500a8d242bf43a9b2fd538c3b1bb037/roles/6dc9a8ecd98b4fab8314890bf5b2bad9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:37:36.042594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368f610-a0b8-46db-9e98-c1780999aed3 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.043214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368f610-a0b8-46db-9e98-c1780999aed3 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.043214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b368f610-a0b8-46db-9e98-c1780999aed3 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.044939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 536/1076] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:36.050485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2db5d-e54a-44be-af56-b67f1e9969a7 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.050892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2db5d-e54a-44be-af56-b67f1e9969a7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.051176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2db5d-e54a-44be-af56-b67f1e9969a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.069316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-58e2db5d-e54a-44be-af56-b67f1e9969a7 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:36.070641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-58e2db5d-e54a-44be-af56-b67f1e9969a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:36.127454 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 541/1077] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:36.150942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368f610-a0b8-46db-9e98-c1780999aed3 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.163232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b368f610-a0b8-46db-9e98-c1780999aed3 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.167644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1b2e5-3bd5-4d9f-9160-e119f3a343d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.168507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1b2e5-3bd5-4d9f-9160-e119f3a343d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.168859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1b2e5-3bd5-4d9f-9160-e119f3a343d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.169205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c1b2e5-3bd5-4d9f-9160-e119f3a343d7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.179387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c1b2e5-3bd5-4d9f-9160-e119f3a343d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:36.186763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-08c1b2e5-3bd5-4d9f-9160-e119f3a343d7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:36.188201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 537/1078] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:36.194107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2db5d-e54a-44be-af56-b67f1e9969a7 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.204140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2db5d-e54a-44be-af56-b67f1e9969a7 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.208438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf320a-b978-470a-bfc9-002f4c8f699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.209093 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf320a-b978-470a-bfc9-002f4c8f699a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.209375 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf320a-b978-470a-bfc9-002f4c8f699a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.209651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf320a-b978-470a-bfc9-002f4c8f699a admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.210417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf320a-b978-470a-bfc9-002f4c8f699a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:36.210723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf320a-b978-470a-bfc9-002f4c8f699a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.212350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf320a-b978-470a-bfc9-002f4c8f699a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.221075 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 542/1079] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:36.226824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1b2e5-3bd5-4d9f-9160-e119f3a343d7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.237528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c1b2e5-3bd5-4d9f-9160-e119f3a343d7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.240869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bf5ef-d15c-43e9-8ba4-7abce134aa5f None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.241158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bf5ef-d15c-43e9-8ba4-7abce134aa5f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.241440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bf5ef-d15c-43e9-8ba4-7abce134aa5f None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.242268 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d45b2c-1bf1-4fc5-be95-643a5105dd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.243332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d45b2c-1bf1-4fc5-be95-643a5105dd7a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.243469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 543/1080] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:37:36.243606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d45b2c-1bf1-4fc5-be95-643a5105dd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.243690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d45b2c-1bf1-4fc5-be95-643a5105dd7a admin admin] PATH_INFO: `/v3/users/e12d0623ba954377af00deaee444dedc` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.244925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d45b2c-1bf1-4fc5-be95-643a5105dd7a admin admin] RBAC: Authorizing `identity:get_user(user_id=e12d0623ba954377af00deaee444dedc)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.247042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d45b2c-1bf1-4fc5-be95-643a5105dd7a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.248186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4445f1-4731-4c1a-a695-756bb276374a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.249140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4445f1-4731-4c1a-a695-756bb276374a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.249266 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 538/1081] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/users/e12d0623ba954377af00deaee444dedc => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:36.249468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4445f1-4731-4c1a-a695-756bb276374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.254471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d45b2c-1bf1-4fc5-be95-643a5105dd7a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.263640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d45b2c-1bf1-4fc5-be95-643a5105dd7a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.268892 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f42c32-8c6e-42b8-a7b2-be386540f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.269186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-db4445f1-4731-4c1a-a695-756bb276374a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:36.269709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f42c32-8c6e-42b8-a7b2-be386540f8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.269994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f42c32-8c6e-42b8-a7b2-be386540f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.270275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f42c32-8c6e-42b8-a7b2-be386540f8b1 admin admin] PATH_INFO: `/v3/projects/2f9a395afe664af38f2d9876ab31c456` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.270581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-db4445f1-4731-4c1a-a695-756bb276374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:36.271442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f42c32-8c6e-42b8-a7b2-be386540f8b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=2f9a395afe664af38f2d9876ab31c456)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.273468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f42c32-8c6e-42b8-a7b2-be386540f8b1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.280409 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 539/1082] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/projects/2f9a395afe664af38f2d9876ab31c456 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:36.280538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 544/1083] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:37:36.281544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f42c32-8c6e-42b8-a7b2-be386540f8b1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.291853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f42c32-8c6e-42b8-a7b2-be386540f8b1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.297362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f089bb-1de5-4933-b516-4af08d63b32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.298264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f089bb-1de5-4933-b516-4af08d63b32e admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.298582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f089bb-1de5-4933-b516-4af08d63b32e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.298895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f089bb-1de5-4933-b516-4af08d63b32e admin admin] PATH_INFO: `/v3/projects/2f9a395afe664af38f2d9876ab31c456/users/e12d0623ba954377af00deaee444dedc/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.301050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f089bb-1de5-4933-b516-4af08d63b32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9a395afe664af38f2d9876ab31c456, user_id=e12d0623ba954377af00deaee444dedc, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.303895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4445f1-4731-4c1a-a695-756bb276374a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.304099 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f089bb-1de5-4933-b516-4af08d63b32e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.313313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4445f1-4731-4c1a-a695-756bb276374a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.318406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 540/1084] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:37:36 2022] PUT /identity/v3/projects/2f9a395afe664af38f2d9876ab31c456/users/e12d0623ba954377af00deaee444dedc/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:37:36.370388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac6469-f58a-4e25-9896-36cf7c7d4f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.371222 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac6469-f58a-4e25-9896-36cf7c7d4f1b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.371505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac6469-f58a-4e25-9896-36cf7c7d4f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.371810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac6469-f58a-4e25-9896-36cf7c7d4f1b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.383463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac6469-f58a-4e25-9896-36cf7c7d4f1b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:36.390952 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-eaac6469-f58a-4e25-9896-36cf7c7d4f1b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jan 27 16:37:36.392252 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 545/1085] 10.222.0.48 () {56 vars in 1141 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:36.398400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f089bb-1de5-4933-b516-4af08d63b32e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.409387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f089bb-1de5-4933-b516-4af08d63b32e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.414326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e55658-24cc-4675-83b6-4bc0399be135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.415010 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55658-24cc-4675-83b6-4bc0399be135 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.415296 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55658-24cc-4675-83b6-4bc0399be135 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.415593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e55658-24cc-4675-83b6-4bc0399be135 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.416384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e55658-24cc-4675-83b6-4bc0399be135 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:36.416693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e55658-24cc-4675-83b6-4bc0399be135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.418320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e55658-24cc-4675-83b6-4bc0399be135 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.432532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 541/1086] 10.222.0.48 () {56 vars in 1136 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:36.433868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac6469-f58a-4e25-9896-36cf7c7d4f1b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.443926 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac6469-f58a-4e25-9896-36cf7c7d4f1b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.448423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba8c3-ffea-46a6-b151-37d652622526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.449212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba8c3-ffea-46a6-b151-37d652622526 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.449492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba8c3-ffea-46a6-b151-37d652622526 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.449766 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba8c3-ffea-46a6-b151-37d652622526 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.462358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aba8c3-ffea-46a6-b151-37d652622526 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.464260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aba8c3-ffea-46a6-b151-37d652622526 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.481839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-a7aba8c3-ffea-46a6-b151-37d652622526 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:36.483618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 546/1087] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:36.489937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e55658-24cc-4675-83b6-4bc0399be135 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.499931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e55658-24cc-4675-83b6-4bc0399be135 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.504409 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410978-8719-4afd-a5ee-2538bc92a4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.505063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410978-8719-4afd-a5ee-2538bc92a4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.505342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410978-8719-4afd-a5ee-2538bc92a4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.505613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23410978-8719-4afd-a5ee-2538bc92a4f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.506340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23410978-8719-4afd-a5ee-2538bc92a4f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:36.506644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23410978-8719-4afd-a5ee-2538bc92a4f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.508260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23410978-8719-4afd-a5ee-2538bc92a4f4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.520685 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 542/1088] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:36.526323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba8c3-ffea-46a6-b151-37d652622526 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.536940 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba8c3-ffea-46a6-b151-37d652622526 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.541399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642795b-ad3e-46b7-9170-f5f17e6a361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.542183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642795b-ad3e-46b7-9170-f5f17e6a361d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.542473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642795b-ad3e-46b7-9170-f5f17e6a361d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.542753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642795b-ad3e-46b7-9170-f5f17e6a361d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.550922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642795b-ad3e-46b7-9170-f5f17e6a361d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.552927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642795b-ad3e-46b7-9170-f5f17e6a361d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.566059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-3642795b-ad3e-46b7-9170-f5f17e6a361d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jan 27 16:37:36.567225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 547/1089] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:36.572885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410978-8719-4afd-a5ee-2538bc92a4f4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.583357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23410978-8719-4afd-a5ee-2538bc92a4f4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.587883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a91a55-c439-4fad-b459-289e9ed2d3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.588539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a91a55-c439-4fad-b459-289e9ed2d3bb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.588823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a91a55-c439-4fad-b459-289e9ed2d3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.589186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a91a55-c439-4fad-b459-289e9ed2d3bb admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.590034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a91a55-c439-4fad-b459-289e9ed2d3bb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:36.590343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a91a55-c439-4fad-b459-289e9ed2d3bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.592800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a91a55-c439-4fad-b459-289e9ed2d3bb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.609947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 543/1090] 10.222.0.48 () {56 vars in 1154 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:36.615604 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642795b-ad3e-46b7-9170-f5f17e6a361d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.625317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642795b-ad3e-46b7-9170-f5f17e6a361d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.629855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81712ce4-c917-4ad6-9977-0669790f64a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.630489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81712ce4-c917-4ad6-9977-0669790f64a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.630774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81712ce4-c917-4ad6-9977-0669790f64a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.631055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81712ce4-c917-4ad6-9977-0669790f64a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.638744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81712ce4-c917-4ad6-9977-0669790f64a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.641229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81712ce4-c917-4ad6-9977-0669790f64a8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.650059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 548/1091] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:37:36.656402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a91a55-c439-4fad-b459-289e9ed2d3bb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.666133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a91a55-c439-4fad-b459-289e9ed2d3bb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.670629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e233-08a4-446d-914c-1c2fdbd1029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.671474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e233-08a4-446d-914c-1c2fdbd1029e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.671796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e233-08a4-446d-914c-1c2fdbd1029e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.672076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e233-08a4-446d-914c-1c2fdbd1029e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.681999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312e233-08a4-446d-914c-1c2fdbd1029e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.683844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312e233-08a4-446d-914c-1c2fdbd1029e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.700006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-3312e233-08a4-446d-914c-1c2fdbd1029e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:37:36.701150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 544/1092] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:36.707129 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81712ce4-c917-4ad6-9977-0669790f64a8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.716150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81712ce4-c917-4ad6-9977-0669790f64a8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.721467 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ec50-8b25-4386-bfcd-8047d677e39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.722121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ec50-8b25-4386-bfcd-8047d677e39d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.722408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ec50-8b25-4386-bfcd-8047d677e39d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.722685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7ec50-8b25-4386-bfcd-8047d677e39d admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.723414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7ec50-8b25-4386-bfcd-8047d677e39d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:36.723746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7ec50-8b25-4386-bfcd-8047d677e39d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.725327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7ec50-8b25-4386-bfcd-8047d677e39d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.741465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 549/1093] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:36.742604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e233-08a4-446d-914c-1c2fdbd1029e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.752319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e233-08a4-446d-914c-1c2fdbd1029e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.756768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0b0cf-b088-4fc4-9875-e43bf3bd54c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.757532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0b0cf-b088-4fc4-9875-e43bf3bd54c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.757816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0b0cf-b088-4fc4-9875-e43bf3bd54c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.758094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0b0cf-b088-4fc4-9875-e43bf3bd54c9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.765919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0b0cf-b088-4fc4-9875-e43bf3bd54c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.768182 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0b0cf-b088-4fc4-9875-e43bf3bd54c9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.782065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-9ff0b0cf-b088-4fc4-9875-e43bf3bd54c9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:37:36.787954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 545/1094] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:36.789095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ec50-8b25-4386-bfcd-8047d677e39d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.798825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7ec50-8b25-4386-bfcd-8047d677e39d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.803429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f7f09-2c5f-4dfb-92a8-3a7d342e2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.804056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f7f09-2c5f-4dfb-92a8-3a7d342e2242 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.804341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f7f09-2c5f-4dfb-92a8-3a7d342e2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.804621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f7f09-2c5f-4dfb-92a8-3a7d342e2242 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.805418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f7f09-2c5f-4dfb-92a8-3a7d342e2242 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:36.805732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f7f09-2c5f-4dfb-92a8-3a7d342e2242 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.807556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f7f09-2c5f-4dfb-92a8-3a7d342e2242 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.819721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 550/1095] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:36.825411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0b0cf-b088-4fc4-9875-e43bf3bd54c9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:36.836810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0b0cf-b088-4fc4-9875-e43bf3bd54c9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:36.841362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561ebe9-e17b-455d-b7ab-fb4493db54f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:36.841990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561ebe9-e17b-455d-b7ab-fb4493db54f4 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:36.842300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561ebe9-e17b-455d-b7ab-fb4493db54f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:36.842581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561ebe9-e17b-455d-b7ab-fb4493db54f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:36.843407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561ebe9-e17b-455d-b7ab-fb4493db54f4 admin admin] RBAC: Adding query filter params (role.id=6dc9a8ecd98b4fab8314890bf5b2bad9, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=8500a8d242bf43a9b2fd538c3b1bb037) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:36.843753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561ebe9-e17b-455d-b7ab-fb4493db54f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:36.845574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8561ebe9-e17b-455d-b7ab-fb4493db54f4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:36.851345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 546/1096] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:36 2022] GET /identity/v3/role_assignments?user.id=8500a8d242bf43a9b2fd538c3b1bb037&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=6dc9a8ecd98b4fab8314890bf5b2bad9 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:38.569740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed80ae-816c-47af-86a0-881a08e79a68 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:38.570227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed80ae-816c-47af-86a0-881a08e79a68 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:38.570318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed80ae-816c-47af-86a0-881a08e79a68 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:38.572108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 551/1097] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:38.577968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85807ad-d1a1-409e-91f9-5f731126fe5d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:38.578366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85807ad-d1a1-409e-91f9-5f731126fe5d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:38.578517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85807ad-d1a1-409e-91f9-5f731126fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:38.595694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e85807ad-d1a1-409e-91f9-5f731126fe5d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:38.596881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e85807ad-d1a1-409e-91f9-5f731126fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:38.604329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 547/1098] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:38.628411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed80ae-816c-47af-86a0-881a08e79a68 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:38.640519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed80ae-816c-47af-86a0-881a08e79a68 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:38.644841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bb643-b323-4121-92c8-ed175be8abc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:38.645606 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bb643-b323-4121-92c8-ed175be8abc4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:38.645891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bb643-b323-4121-92c8-ed175be8abc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:38.646166 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bb643-b323-4121-92c8-ed175be8abc4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:38.656640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bb643-b323-4121-92c8-ed175be8abc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:38.663764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-613bb643-b323-4121-92c8-ed175be8abc4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:38.664896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 552/1099] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:38.671367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85807ad-d1a1-409e-91f9-5f731126fe5d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:38.680107 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85807ad-d1a1-409e-91f9-5f731126fe5d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:38.684532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a72d5-cc20-404b-a1fb-ebc91bf70602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:38.685177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a72d5-cc20-404b-a1fb-ebc91bf70602 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:38.685460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a72d5-cc20-404b-a1fb-ebc91bf70602 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:38.685736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a72d5-cc20-404b-a1fb-ebc91bf70602 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:38.686614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a72d5-cc20-404b-a1fb-ebc91bf70602 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:38.686915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a72d5-cc20-404b-a1fb-ebc91bf70602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:38.688545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a72d5-cc20-404b-a1fb-ebc91bf70602 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:38.696954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 548/1100] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:38.703023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bb643-b323-4121-92c8-ed175be8abc4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:38.713069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bb643-b323-4121-92c8-ed175be8abc4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:38.718111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670c086-122b-4356-b0d7-90e725d999ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:38.719963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c086-122b-4356-b0d7-90e725d999ca admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:38.719963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c086-122b-4356-b0d7-90e725d999ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:38.719963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c086-122b-4356-b0d7-90e725d999ca admin admin] PATH_INFO: `/v3/users/e12d0623ba954377af00deaee444dedc` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:38.720687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670c086-122b-4356-b0d7-90e725d999ca admin admin] RBAC: Authorizing `identity:get_user(user_id=e12d0623ba954377af00deaee444dedc)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:38.722779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670c086-122b-4356-b0d7-90e725d999ca admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:38.724358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 553/1101] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:38 2022] GET /identity/v3/users/e12d0623ba954377af00deaee444dedc => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:38.729558 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a72d5-cc20-404b-a1fb-ebc91bf70602 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:38.738808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a72d5-cc20-404b-a1fb-ebc91bf70602 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:38.743223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af285a-7516-4039-936a-d6abde645215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:38.743866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af285a-7516-4039-936a-d6abde645215 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:38.744151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af285a-7516-4039-936a-d6abde645215 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:38.744425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af285a-7516-4039-936a-d6abde645215 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:38.751865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af285a-7516-4039-936a-d6abde645215 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:38.753566 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af285a-7516-4039-936a-d6abde645215 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:38.761963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 549/1102] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:38 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:38.768579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670c086-122b-4356-b0d7-90e725d999ca admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:38.778774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670c086-122b-4356-b0d7-90e725d999ca admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:38.784150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb88285-a9b6-4f36-b35f-d051ff39e8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:38.784977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88285-a9b6-4f36-b35f-d051ff39e8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:38.785262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88285-a9b6-4f36-b35f-d051ff39e8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:38.785796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb88285-a9b6-4f36-b35f-d051ff39e8f1 admin admin] PATH_INFO: `/v3/projects/2f9a395afe664af38f2d9876ab31c456` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:38.786969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb88285-a9b6-4f36-b35f-d051ff39e8f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=2f9a395afe664af38f2d9876ab31c456)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:38.789032 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb88285-a9b6-4f36-b35f-d051ff39e8f1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:38.790662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 554/1103] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:37:38 2022] GET /identity/v3/projects/2f9a395afe664af38f2d9876ab31c456 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:38.796837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af285a-7516-4039-936a-d6abde645215 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:38.805309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af285a-7516-4039-936a-d6abde645215 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:38.809710 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bef4f1-af69-44c2-a7ad-77ef5bdc54ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:38.810324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bef4f1-af69-44c2-a7ad-77ef5bdc54ed admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:38.810605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bef4f1-af69-44c2-a7ad-77ef5bdc54ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:38.810884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bef4f1-af69-44c2-a7ad-77ef5bdc54ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:38.812195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bef4f1-af69-44c2-a7ad-77ef5bdc54ed admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=2f9a395afe664af38f2d9876ab31c456, user.id=e12d0623ba954377af00deaee444dedc) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:38.812507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bef4f1-af69-44c2-a7ad-77ef5bdc54ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:38.814296 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bef4f1-af69-44c2-a7ad-77ef5bdc54ed admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:38.819753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 550/1104] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:38 2022] GET /identity/v3/role_assignments?user.id=e12d0623ba954377af00deaee444dedc&scope.project.id=2f9a395afe664af38f2d9876ab31c456&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:41.034008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396e8c-d1bb-4294-b607-45cba82d5c70 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:41.034520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396e8c-d1bb-4294-b607-45cba82d5c70 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:41.034631 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a396e8c-d1bb-4294-b607-45cba82d5c70 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:41.036693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 555/1105] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:41.041796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8431-f454-4a8e-ae79-2e5d6d5cbad9 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:41.042209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8431-f454-4a8e-ae79-2e5d6d5cbad9 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:41.042360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8431-f454-4a8e-ae79-2e5d6d5cbad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:41.060283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-90cd8431-f454-4a8e-ae79-2e5d6d5cbad9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:41.062159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-90cd8431-f454-4a8e-ae79-2e5d6d5cbad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:41.069948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 551/1106] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:41.097266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a396e8c-d1bb-4294-b607-45cba82d5c70 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:41.110158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a396e8c-d1bb-4294-b607-45cba82d5c70 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:41.114846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd0d10-1cbe-4717-9599-cd0e44b83572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:41.115763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0d10-1cbe-4717-9599-cd0e44b83572 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:41.116074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0d10-1cbe-4717-9599-cd0e44b83572 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:41.116393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd0d10-1cbe-4717-9599-cd0e44b83572 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:41.117684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd0d10-1cbe-4717-9599-cd0e44b83572 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:41.119762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd0d10-1cbe-4717-9599-cd0e44b83572 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:41.121512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 556/1107] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:41.127410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8431-f454-4a8e-ae79-2e5d6d5cbad9 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:41.136201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8431-f454-4a8e-ae79-2e5d6d5cbad9 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:41.140880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137069f-cb8a-4809-a66f-8fed952f70dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:41.141529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137069f-cb8a-4809-a66f-8fed952f70dd admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:41.141813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137069f-cb8a-4809-a66f-8fed952f70dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:41.142093 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137069f-cb8a-4809-a66f-8fed952f70dd admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:41.142816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137069f-cb8a-4809-a66f-8fed952f70dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:41.144743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137069f-cb8a-4809-a66f-8fed952f70dd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:41.166755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 552/1108] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:37:41 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:43.387370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2aef-22f4-46ad-ac0e-bd823671ae79 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:43.387964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2aef-22f4-46ad-ac0e-bd823671ae79 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:43.387964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff2aef-22f4-46ad-ac0e-bd823671ae79 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:43.390516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 557/1109] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:43.395771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7245-19b3-4102-b1bf-b7db26aceacf None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:43.396191 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7245-19b3-4102-b1bf-b7db26aceacf None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:43.396331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c7245-19b3-4102-b1bf-b7db26aceacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:43.416239 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a37c7245-19b3-4102-b1bf-b7db26aceacf None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:43.417482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a37c7245-19b3-4102-b1bf-b7db26aceacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:43.425305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 553/1110] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:43.448988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2aef-22f4-46ad-ac0e-bd823671ae79 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:43.461496 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff2aef-22f4-46ad-ac0e-bd823671ae79 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:43.465857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac25eb-9323-468a-a36e-231d0cab175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:43.466684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac25eb-9323-468a-a36e-231d0cab175b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:43.466966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac25eb-9323-468a-a36e-231d0cab175b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:43.467390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac25eb-9323-468a-a36e-231d0cab175b admin admin] PATH_INFO: `/v3/roles/27ceba94bdd34cc790ee9e7b8fb06d57` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:43.469456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac25eb-9323-468a-a36e-231d0cab175b admin admin] RBAC: Authorizing `identity:get_role(role_id=27ceba94bdd34cc790ee9e7b8fb06d57)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:43.470466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-c3ac25eb-9323-468a-a36e-231d0cab175b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:43.470466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:37:43.470466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:37:43.471372 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac25eb-9323-468a-a36e-231d0cab175b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:43.472709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 558/1111] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:43 2022] GET /identity/v3/roles/27ceba94bdd34cc790ee9e7b8fb06d57 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:43.478015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c7245-19b3-4102-b1bf-b7db26aceacf None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:43.486969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c7245-19b3-4102-b1bf-b7db26aceacf None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:43.491373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab13eb6-2703-41f2-8035-e208f9edf819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:43.492244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab13eb6-2703-41f2-8035-e208f9edf819 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:43.492522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab13eb6-2703-41f2-8035-e208f9edf819 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:43.492792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab13eb6-2703-41f2-8035-e208f9edf819 admin admin] PATH_INFO: `/v3/users/01236627b6a9434d941bb2264075d9d3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:43.505961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab13eb6-2703-41f2-8035-e208f9edf819 admin admin] RBAC: Authorizing `identity:get_user(user_id=01236627b6a9434d941bb2264075d9d3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:43.508097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab13eb6-2703-41f2-8035-e208f9edf819 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:43.509692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 554/1112] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:43 2022] GET /identity/v3/users/01236627b6a9434d941bb2264075d9d3 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:43.515918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac25eb-9323-468a-a36e-231d0cab175b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:43.525851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac25eb-9323-468a-a36e-231d0cab175b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:43.530390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a48555-ed9e-4dc4-bd98-0fb9be3de7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:43.531014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48555-ed9e-4dc4-bd98-0fb9be3de7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:43.531298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48555-ed9e-4dc4-bd98-0fb9be3de7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:43.531590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a48555-ed9e-4dc4-bd98-0fb9be3de7a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:43.539871 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a48555-ed9e-4dc4-bd98-0fb9be3de7a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:43.541594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a48555-ed9e-4dc4-bd98-0fb9be3de7a6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:43.550447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 559/1113] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:43 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:43.556101 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab13eb6-2703-41f2-8035-e208f9edf819 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:43.566100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab13eb6-2703-41f2-8035-e208f9edf819 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:43.570642 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901f6da-906f-4380-aeff-b7d1d97d65ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:43.571474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f6da-906f-4380-aeff-b7d1d97d65ae admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:43.571798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f6da-906f-4380-aeff-b7d1d97d65ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:43.572078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901f6da-906f-4380-aeff-b7d1d97d65ae admin admin] PATH_INFO: `/v3/projects/2f9a395afe664af38f2d9876ab31c456` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:43.573254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f6da-906f-4380-aeff-b7d1d97d65ae admin admin] RBAC: Authorizing `identity:get_project(project_id=2f9a395afe664af38f2d9876ab31c456)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:43.575270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901f6da-906f-4380-aeff-b7d1d97d65ae admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:43.577592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 555/1114] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:37:43 2022] GET /identity/v3/projects/2f9a395afe664af38f2d9876ab31c456 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:43.583255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a48555-ed9e-4dc4-bd98-0fb9be3de7a6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:43.591814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a48555-ed9e-4dc4-bd98-0fb9be3de7a6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:43.596372 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0375a7f7-332f-4163-9436-e174064800d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:43.596996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375a7f7-332f-4163-9436-e174064800d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:43.597305 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375a7f7-332f-4163-9436-e174064800d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:43.597583 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0375a7f7-332f-4163-9436-e174064800d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:43.598409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375a7f7-332f-4163-9436-e174064800d3 admin admin] RBAC: Adding query filter params (role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=2f9a395afe664af38f2d9876ab31c456, user.id=01236627b6a9434d941bb2264075d9d3) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:43.598720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375a7f7-332f-4163-9436-e174064800d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:43.600572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0375a7f7-332f-4163-9436-e174064800d3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:43.605713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 560/1115] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:43 2022] GET /identity/v3/role_assignments?user.id=01236627b6a9434d941bb2264075d9d3&scope.project.id=2f9a395afe664af38f2d9876ab31c456&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:45.757351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b8cc-8f1b-40d7-9974-e85777061c2d None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:45.757904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b8cc-8f1b-40d7-9974-e85777061c2d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:45.757904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610b8cc-8f1b-40d7-9974-e85777061c2d None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:45.759680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 556/1116] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:45.765737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2602a-b1fe-49bb-8e82-09766ff14fb4 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:45.766126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2602a-b1fe-49bb-8e82-09766ff14fb4 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:45.766292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2602a-b1fe-49bb-8e82-09766ff14fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:45.784125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d5e2602a-b1fe-49bb-8e82-09766ff14fb4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:45.785303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d5e2602a-b1fe-49bb-8e82-09766ff14fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:45.792958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 561/1117] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:45.816855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610b8cc-8f1b-40d7-9974-e85777061c2d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:45.829244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610b8cc-8f1b-40d7-9974-e85777061c2d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:45.833531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211302-0691-4d93-b27c-16b4666e388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:45.834352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211302-0691-4d93-b27c-16b4666e388d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:45.834634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211302-0691-4d93-b27c-16b4666e388d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:45.834912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09211302-0691-4d93-b27c-16b4666e388d admin admin] PATH_INFO: `/v3/roles/27ceba94bdd34cc790ee9e7b8fb06d57` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:45.836417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09211302-0691-4d93-b27c-16b4666e388d admin admin] RBAC: Authorizing `identity:get_role(role_id=27ceba94bdd34cc790ee9e7b8fb06d57)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:45.837485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-09211302-0691-4d93-b27c-16b4666e388d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:37:45.837485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:37:45.837485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:37:45.838366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09211302-0691-4d93-b27c-16b4666e388d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:45.839687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 557/1118] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:45 2022] GET /identity/v3/roles/27ceba94bdd34cc790ee9e7b8fb06d57 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:45.845278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2602a-b1fe-49bb-8e82-09766ff14fb4 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:45.853867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2602a-b1fe-49bb-8e82-09766ff14fb4 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:45.858441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589839e9-e105-40c2-81c7-68e05dc19fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:45.859288 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589839e9-e105-40c2-81c7-68e05dc19fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:45.859593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589839e9-e105-40c2-81c7-68e05dc19fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:45.859918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589839e9-e105-40c2-81c7-68e05dc19fa5 admin admin] PATH_INFO: `/v3/users/01236627b6a9434d941bb2264075d9d3` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:45.861063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589839e9-e105-40c2-81c7-68e05dc19fa5 admin admin] RBAC: Authorizing `identity:get_user(user_id=01236627b6a9434d941bb2264075d9d3)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:45.863147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589839e9-e105-40c2-81c7-68e05dc19fa5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:45.864724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 562/1119] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:45 2022] GET /identity/v3/users/01236627b6a9434d941bb2264075d9d3 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:45.869838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211302-0691-4d93-b27c-16b4666e388d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:45.879853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09211302-0691-4d93-b27c-16b4666e388d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:45.884240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94255-a14a-4316-8f49-51aeebfaef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:45.885048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94255-a14a-4316-8f49-51aeebfaef79 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:45.885330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94255-a14a-4316-8f49-51aeebfaef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:45.885601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94255-a14a-4316-8f49-51aeebfaef79 admin admin] PATH_INFO: `/v3/projects/2f9a395afe664af38f2d9876ab31c456` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:45.886760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f94255-a14a-4316-8f49-51aeebfaef79 admin admin] RBAC: Authorizing `identity:get_project(project_id=2f9a395afe664af38f2d9876ab31c456)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:45.888825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f94255-a14a-4316-8f49-51aeebfaef79 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:45.891187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 558/1120] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:37:45 2022] GET /identity/v3/projects/2f9a395afe664af38f2d9876ab31c456 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:45.896925 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589839e9-e105-40c2-81c7-68e05dc19fa5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:45.906284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589839e9-e105-40c2-81c7-68e05dc19fa5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:45.910915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206c2a9-9113-48fc-832c-bc58bdebbe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:45.911787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206c2a9-9113-48fc-832c-bc58bdebbe11 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:45.912068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206c2a9-9113-48fc-832c-bc58bdebbe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:45.912341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206c2a9-9113-48fc-832c-bc58bdebbe11 admin admin] PATH_INFO: `/v3/projects/2f9a395afe664af38f2d9876ab31c456/users/01236627b6a9434d941bb2264075d9d3/roles/27ceba94bdd34cc790ee9e7b8fb06d57` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:45.914515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206c2a9-9113-48fc-832c-bc58bdebbe11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9a395afe664af38f2d9876ab31c456, user_id=01236627b6a9434d941bb2264075d9d3, role_id=27ceba94bdd34cc790ee9e7b8fb06d57)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:45.917135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206c2a9-9113-48fc-832c-bc58bdebbe11 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:45.929363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 563/1121] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:37:45 2022] PUT /identity/v3/projects/2f9a395afe664af38f2d9876ab31c456/users/01236627b6a9434d941bb2264075d9d3/roles/27ceba94bdd34cc790ee9e7b8fb06d57 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:37:48.121103 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740e84-90ae-40f2-8c0b-4e2a5ad83887 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:48.121680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740e84-90ae-40f2-8c0b-4e2a5ad83887 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:48.121680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a740e84-90ae-40f2-8c0b-4e2a5ad83887 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:48.123425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 559/1122] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:48.129203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08f4d-f21d-4a9d-bba3-2b1d441e0952 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:48.129581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08f4d-f21d-4a9d-bba3-2b1d441e0952 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:48.129757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f08f4d-f21d-4a9d-bba3-2b1d441e0952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:48.152855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-83f08f4d-f21d-4a9d-bba3-2b1d441e0952 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:48.154034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-83f08f4d-f21d-4a9d-bba3-2b1d441e0952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:48.210500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 564/1123] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:48.234461 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a740e84-90ae-40f2-8c0b-4e2a5ad83887 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:48.246254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a740e84-90ae-40f2-8c0b-4e2a5ad83887 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:48.251205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1cc7-62ae-4ad7-bd41-85cab4fea26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:48.252069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1cc7-62ae-4ad7-bd41-85cab4fea26b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:48.252354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1cc7-62ae-4ad7-bd41-85cab4fea26b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:48.252630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad1cc7-62ae-4ad7-bd41-85cab4fea26b admin admin] PATH_INFO: `/v3/roles/27ceba94bdd34cc790ee9e7b8fb06d57` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:48.254086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad1cc7-62ae-4ad7-bd41-85cab4fea26b admin admin] RBAC: Authorizing `identity:get_role(role_id=27ceba94bdd34cc790ee9e7b8fb06d57)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:48.255692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ad1cc7-62ae-4ad7-bd41-85cab4fea26b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:48.256984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 560/1124] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:48 2022] GET /identity/v3/roles/27ceba94bdd34cc790ee9e7b8fb06d57 => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:48.262330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08f4d-f21d-4a9d-bba3-2b1d441e0952 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:48.271077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f08f4d-f21d-4a9d-bba3-2b1d441e0952 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:48.275484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1ea8-7c01-4ec0-9e56-4581cb457fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:48.276358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1ea8-7c01-4ec0-9e56-4581cb457fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:48.276639 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1ea8-7c01-4ec0-9e56-4581cb457fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:48.276920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e1ea8-7c01-4ec0-9e56-4581cb457fd0 admin admin] PATH_INFO: `/v3/users/01236627b6a9434d941bb2264075d9d3` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:48.278104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e1ea8-7c01-4ec0-9e56-4581cb457fd0 admin admin] RBAC: Authorizing `identity:get_user(user_id=01236627b6a9434d941bb2264075d9d3)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:48.280919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e1ea8-7c01-4ec0-9e56-4581cb457fd0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:48.282469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 565/1125] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:48 2022] GET /identity/v3/users/01236627b6a9434d941bb2264075d9d3 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:48.288154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1cc7-62ae-4ad7-bd41-85cab4fea26b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:48.297943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad1cc7-62ae-4ad7-bd41-85cab4fea26b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:48.302429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f5331-3a24-4894-aed7-74ee1c05a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:48.303042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f5331-3a24-4894-aed7-74ee1c05a7ff admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:48.303325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f5331-3a24-4894-aed7-74ee1c05a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:48.303630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f5331-3a24-4894-aed7-74ee1c05a7ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:48.311253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f5331-3a24-4894-aed7-74ee1c05a7ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:48.313054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f5331-3a24-4894-aed7-74ee1c05a7ff admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:48.321642 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 561/1126] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:48 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:48.327509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1ea8-7c01-4ec0-9e56-4581cb457fd0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:48.336702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e1ea8-7c01-4ec0-9e56-4581cb457fd0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:48.341151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d894f-884e-4bbd-aaeb-9ea908fe75d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:48.341962 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d894f-884e-4bbd-aaeb-9ea908fe75d0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:48.342808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d894f-884e-4bbd-aaeb-9ea908fe75d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:48.343553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d894f-884e-4bbd-aaeb-9ea908fe75d0 admin admin] PATH_INFO: `/v3/projects/2f9a395afe664af38f2d9876ab31c456` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:48.344749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d894f-884e-4bbd-aaeb-9ea908fe75d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=2f9a395afe664af38f2d9876ab31c456)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:48.346729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d894f-884e-4bbd-aaeb-9ea908fe75d0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:48.348369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 566/1127] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:37:48 2022] GET /identity/v3/projects/2f9a395afe664af38f2d9876ab31c456 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:48.353850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f5331-3a24-4894-aed7-74ee1c05a7ff admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:48.362934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f5331-3a24-4894-aed7-74ee1c05a7ff admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:48.367395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d4c8f-0268-47ef-b8a8-31243b6053bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:48.368041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d4c8f-0268-47ef-b8a8-31243b6053bc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:48.368325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d4c8f-0268-47ef-b8a8-31243b6053bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:48.368597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d4c8f-0268-47ef-b8a8-31243b6053bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:48.369410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d4c8f-0268-47ef-b8a8-31243b6053bc admin admin] RBAC: Adding query filter params (role.id=27ceba94bdd34cc790ee9e7b8fb06d57, scope.project.id=2f9a395afe664af38f2d9876ab31c456, user.id=01236627b6a9434d941bb2264075d9d3) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:48.369719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d4c8f-0268-47ef-b8a8-31243b6053bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:48.371556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d4c8f-0268-47ef-b8a8-31243b6053bc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:48.377204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 562/1128] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:48 2022] GET /identity/v3/role_assignments?user.id=01236627b6a9434d941bb2264075d9d3&scope.project.id=2f9a395afe664af38f2d9876ab31c456&role.id=27ceba94bdd34cc790ee9e7b8fb06d57 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:50.614363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35894-f576-45e7-8613-10e2f07911d9 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:50.614876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35894-f576-45e7-8613-10e2f07911d9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:50.614977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e35894-f576-45e7-8613-10e2f07911d9 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:50.616699 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 567/1129] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:50.621917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e583f2-f473-41f4-89fa-12dd753b9440 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:50.622292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e583f2-f473-41f4-89fa-12dd753b9440 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:50.622470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e583f2-f473-41f4-89fa-12dd753b9440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:50.639451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e1e583f2-f473-41f4-89fa-12dd753b9440 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:50.640648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e1e583f2-f473-41f4-89fa-12dd753b9440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:50.648131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 563/1130] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:50.673414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35894-f576-45e7-8613-10e2f07911d9 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:50.685338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e35894-f576-45e7-8613-10e2f07911d9 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:50.689802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10eadd-2b59-4708-af78-71ec94ab7ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:50.690571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10eadd-2b59-4708-af78-71ec94ab7ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:50.690857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10eadd-2b59-4708-af78-71ec94ab7ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:50.691135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10eadd-2b59-4708-af78-71ec94ab7ae7 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:50.692329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10eadd-2b59-4708-af78-71ec94ab7ae7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:50.694009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10eadd-2b59-4708-af78-71ec94ab7ae7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:50.695558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 568/1131] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:50.700733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e583f2-f473-41f4-89fa-12dd753b9440 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:50.709736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e583f2-f473-41f4-89fa-12dd753b9440 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:50.714100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13d678-eae0-4d78-b5ff-7c2d8c9bd4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:50.714727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d678-eae0-4d78-b5ff-7c2d8c9bd4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:50.715009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d678-eae0-4d78-b5ff-7c2d8c9bd4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:50.715286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13d678-eae0-4d78-b5ff-7c2d8c9bd4b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:50.716028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13d678-eae0-4d78-b5ff-7c2d8c9bd4b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:50.718488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13d678-eae0-4d78-b5ff-7c2d8c9bd4b4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:50.741937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 564/1132] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:37:50 2022] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:53.028703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140473-8578-4ace-a849-90962ef7c0f8 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:53.029235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140473-8578-4ace-a849-90962ef7c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:53.029235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e140473-8578-4ace-a849-90962ef7c0f8 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:53.031033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 569/1133] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:53.036436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0e22-fa86-47f9-8180-bc0f0d5ef989 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:53.036810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0e22-fa86-47f9-8180-bc0f0d5ef989 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:53.036993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e0e22-fa86-47f9-8180-bc0f0d5ef989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:53.055161 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-7c4e0e22-fa86-47f9-8180-bc0f0d5ef989 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:53.056366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7c4e0e22-fa86-47f9-8180-bc0f0d5ef989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:53.111815 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 565/1134] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:53 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:53.137026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e140473-8578-4ace-a849-90962ef7c0f8 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:53.148797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e140473-8578-4ace-a849-90962ef7c0f8 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:53.152999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ba057-0400-45cf-8428-e1bfb1576af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:53.153761 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba057-0400-45cf-8428-e1bfb1576af6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:53.154040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba057-0400-45cf-8428-e1bfb1576af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:53.154313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ba057-0400-45cf-8428-e1bfb1576af6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:53.155639 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba057-0400-45cf-8428-e1bfb1576af6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:53.157309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ba057-0400-45cf-8428-e1bfb1576af6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:53.158846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 570/1135] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:37:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:53.164230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0e22-fa86-47f9-8180-bc0f0d5ef989 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:53.173838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e0e22-fa86-47f9-8180-bc0f0d5ef989 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:53.178233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe5310-01de-4b40-91a9-d0162235e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:53.178878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5310-01de-4b40-91a9-d0162235e84b admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:53.179157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5310-01de-4b40-91a9-d0162235e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:53.179431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5310-01de-4b40-91a9-d0162235e84b admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:53.180269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe5310-01de-4b40-91a9-d0162235e84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:53.182151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fe5310-01de-4b40-91a9-d0162235e84b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:53.201427 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 566/1136] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:37:53 2022] POST /identity/v3/users => generated 286 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:37:55.422271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4cac4-a2df-43d4-bff9-71b0a0d5bec1 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:55.422836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4cac4-a2df-43d4-bff9-71b0a0d5bec1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:55.422836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4cac4-a2df-43d4-bff9-71b0a0d5bec1 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:55.424635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 571/1137] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:55.429762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70737-81c6-43c2-a83b-9fe40d1e9c0b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:55.430183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70737-81c6-43c2-a83b-9fe40d1e9c0b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:55.430326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc70737-81c6-43c2-a83b-9fe40d1e9c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:55.448087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ccc70737-81c6-43c2-a83b-9fe40d1e9c0b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:55.449274 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ccc70737-81c6-43c2-a83b-9fe40d1e9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:55.457005 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 567/1138] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:55.480352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4cac4-a2df-43d4-bff9-71b0a0d5bec1 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:55.492804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4cac4-a2df-43d4-bff9-71b0a0d5bec1 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:55.497120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe539c7-9f1e-4632-82e2-fed7bf702a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:55.497888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe539c7-9f1e-4632-82e2-fed7bf702a8e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:55.498169 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe539c7-9f1e-4632-82e2-fed7bf702a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:55.498440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe539c7-9f1e-4632-82e2-fed7bf702a8e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:55.508970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe539c7-9f1e-4632-82e2-fed7bf702a8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:55.517370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-1fe539c7-9f1e-4632-82e2-fed7bf702a8e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:55.518546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 572/1139] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:37:55.524487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc70737-81c6-43c2-a83b-9fe40d1e9c0b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:55.533911 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc70737-81c6-43c2-a83b-9fe40d1e9c0b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:55.538595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf8801-c4f5-4bfa-a631-7cb91f1a01d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:55.539243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf8801-c4f5-4bfa-a631-7cb91f1a01d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:55.539527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf8801-c4f5-4bfa-a631-7cb91f1a01d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:55.539830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf8801-c4f5-4bfa-a631-7cb91f1a01d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:55.540583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf8801-c4f5-4bfa-a631-7cb91f1a01d3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:55.540889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf8801-c4f5-4bfa-a631-7cb91f1a01d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:55.542477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf8801-c4f5-4bfa-a631-7cb91f1a01d3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:55.550713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 568/1140] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:55.556240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe539c7-9f1e-4632-82e2-fed7bf702a8e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:55.566700 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe539c7-9f1e-4632-82e2-fed7bf702a8e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:55.571154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fede5-8d05-4237-b343-144630898eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:55.572026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fede5-8d05-4237-b343-144630898eee admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:55.572311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fede5-8d05-4237-b343-144630898eee admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:55.572587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0fede5-8d05-4237-b343-144630898eee admin admin] PATH_INFO: `/v3/users/a8d3b96d76f14a488d4049ca3973b6a8` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:55.585532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fede5-8d05-4237-b343-144630898eee admin admin] RBAC: Authorizing `identity:get_user(user_id=a8d3b96d76f14a488d4049ca3973b6a8)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:55.587674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0fede5-8d05-4237-b343-144630898eee admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:55.589257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 573/1141] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:55 2022] GET /identity/v3/users/a8d3b96d76f14a488d4049ca3973b6a8 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:37:55.594864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf8801-c4f5-4bfa-a631-7cb91f1a01d3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:55.604256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf8801-c4f5-4bfa-a631-7cb91f1a01d3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:55.608829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d1f71-7f92-472b-abcc-7b5dc00b805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:55.609452 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1f71-7f92-472b-abcc-7b5dc00b805c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:55.609740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1f71-7f92-472b-abcc-7b5dc00b805c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:55.610021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1f71-7f92-472b-abcc-7b5dc00b805c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:55.617574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d1f71-7f92-472b-abcc-7b5dc00b805c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:55.619284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d1f71-7f92-472b-abcc-7b5dc00b805c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:55.628811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 569/1142] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:37:55 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:37:55.634232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fede5-8d05-4237-b343-144630898eee admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:55.644424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0fede5-8d05-4237-b343-144630898eee admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:55.648848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea3896-50d5-4343-8c0d-3ef13cff8696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:55.649676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea3896-50d5-4343-8c0d-3ef13cff8696 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:55.649959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea3896-50d5-4343-8c0d-3ef13cff8696 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:55.650237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea3896-50d5-4343-8c0d-3ef13cff8696 admin admin] PATH_INFO: `/v3/projects/be849ca61ba54fd482e6cf7e734b9417` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:55.651391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea3896-50d5-4343-8c0d-3ef13cff8696 admin admin] RBAC: Authorizing `identity:get_project(project_id=be849ca61ba54fd482e6cf7e734b9417)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:55.653432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea3896-50d5-4343-8c0d-3ef13cff8696 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:55.655083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 574/1143] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:37:55 2022] GET /identity/v3/projects/be849ca61ba54fd482e6cf7e734b9417 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:55.660491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d1f71-7f92-472b-abcc-7b5dc00b805c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:55.669157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d1f71-7f92-472b-abcc-7b5dc00b805c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:55.673975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba638d5-6745-4168-a5a7-fbd18365a950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:55.674533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba638d5-6745-4168-a5a7-fbd18365a950 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:55.674813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba638d5-6745-4168-a5a7-fbd18365a950 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:55.675086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba638d5-6745-4168-a5a7-fbd18365a950 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:55.675943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba638d5-6745-4168-a5a7-fbd18365a950 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=be849ca61ba54fd482e6cf7e734b9417, user.id=a8d3b96d76f14a488d4049ca3973b6a8) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:55.676253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba638d5-6745-4168-a5a7-fbd18365a950 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:55.678038 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba638d5-6745-4168-a5a7-fbd18365a950 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:55.683145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 570/1144] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:37:55 2022] GET /identity/v3/role_assignments?user.id=a8d3b96d76f14a488d4049ca3973b6a8&scope.project.id=be849ca61ba54fd482e6cf7e734b9417&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:57.876683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57a93b-ed41-4493-94ed-3d443dc8bc0b None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:57.877197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57a93b-ed41-4493-94ed-3d443dc8bc0b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:57.877197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57a93b-ed41-4493-94ed-3d443dc8bc0b None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:57.878926 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 575/1145] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:37:57.884003 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa3fd9-6258-48c8-a14a-9902361c5c61 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:57.884373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa3fd9-6258-48c8-a14a-9902361c5c61 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:57.884562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa3fd9-6258-48c8-a14a-9902361c5c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:57.902446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-dffa3fd9-6258-48c8-a14a-9902361c5c61 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:37:57.903645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-dffa3fd9-6258-48c8-a14a-9902361c5c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:37:57.911711 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 571/1146] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:37:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:37:57.935288 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57a93b-ed41-4493-94ed-3d443dc8bc0b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:57.947832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57a93b-ed41-4493-94ed-3d443dc8bc0b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:57.952632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28722c63-a583-42b4-aa66-c2c9c95d39af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:57.953390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28722c63-a583-42b4-aa66-c2c9c95d39af admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:57.953671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28722c63-a583-42b4-aa66-c2c9c95d39af admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:57.953945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28722c63-a583-42b4-aa66-c2c9c95d39af admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:57.963640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28722c63-a583-42b4-aa66-c2c9c95d39af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:37:57.970526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-28722c63-a583-42b4-aa66-c2c9c95d39af admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:37:57.971667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 576/1147] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:37:57.977441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa3fd9-6258-48c8-a14a-9902361c5c61 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:57.986850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa3fd9-6258-48c8-a14a-9902361c5c61 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:57.992110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab3b05-1c37-4aad-a53f-5eeda0ba95ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:57.992770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab3b05-1c37-4aad-a53f-5eeda0ba95ee admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:57.993055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab3b05-1c37-4aad-a53f-5eeda0ba95ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:57.993336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab3b05-1c37-4aad-a53f-5eeda0ba95ee admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:57.994094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab3b05-1c37-4aad-a53f-5eeda0ba95ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:37:57.994401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab3b05-1c37-4aad-a53f-5eeda0ba95ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:57.996016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab3b05-1c37-4aad-a53f-5eeda0ba95ee admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:58.004814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 572/1148] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:58.010627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28722c63-a583-42b4-aa66-c2c9c95d39af admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:58.021354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28722c63-a583-42b4-aa66-c2c9c95d39af admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:58.025801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556a0e9-da69-42f3-9129-ae6c65e413d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:58.026641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556a0e9-da69-42f3-9129-ae6c65e413d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:58.026921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556a0e9-da69-42f3-9129-ae6c65e413d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:58.027204 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556a0e9-da69-42f3-9129-ae6c65e413d7 admin admin] PATH_INFO: `/v3/users/a8d3b96d76f14a488d4049ca3973b6a8` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:58.028424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556a0e9-da69-42f3-9129-ae6c65e413d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=a8d3b96d76f14a488d4049ca3973b6a8)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:58.030851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556a0e9-da69-42f3-9129-ae6c65e413d7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:58.032446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 577/1149] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:37:58 2022] GET /identity/v3/users/a8d3b96d76f14a488d4049ca3973b6a8 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:58.038064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab3b05-1c37-4aad-a53f-5eeda0ba95ee admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:58.047583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab3b05-1c37-4aad-a53f-5eeda0ba95ee admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:58.052038 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4dcdc1-534e-4238-8244-30a3a13011e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:58.052873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dcdc1-534e-4238-8244-30a3a13011e6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:58.053159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dcdc1-534e-4238-8244-30a3a13011e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:58.053439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4dcdc1-534e-4238-8244-30a3a13011e6 admin admin] PATH_INFO: `/v3/projects/be849ca61ba54fd482e6cf7e734b9417` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:58.054605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dcdc1-534e-4238-8244-30a3a13011e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=be849ca61ba54fd482e6cf7e734b9417)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:58.056685 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4dcdc1-534e-4238-8244-30a3a13011e6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:58.058305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 573/1150] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:37:58 2022] GET /identity/v3/projects/be849ca61ba54fd482e6cf7e734b9417 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:37:58.064661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556a0e9-da69-42f3-9129-ae6c65e413d7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:37:58.073916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556a0e9-da69-42f3-9129-ae6c65e413d7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:37:58.079012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69718a4-ff39-470e-8c54-fb9ecd75d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:37:58.079895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69718a4-ff39-470e-8c54-fb9ecd75d025 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:37:58.080173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69718a4-ff39-470e-8c54-fb9ecd75d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:37:58.080442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69718a4-ff39-470e-8c54-fb9ecd75d025 admin admin] PATH_INFO: `/v3/projects/be849ca61ba54fd482e6cf7e734b9417/users/a8d3b96d76f14a488d4049ca3973b6a8/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:37:58.082402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69718a4-ff39-470e-8c54-fb9ecd75d025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be849ca61ba54fd482e6cf7e734b9417, user_id=a8d3b96d76f14a488d4049ca3973b6a8, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:37:58.085022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69718a4-ff39-470e-8c54-fb9ecd75d025 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:37:58.097035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 578/1151] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:37:58 2022] PUT /identity/v3/projects/be849ca61ba54fd482e6cf7e734b9417/users/a8d3b96d76f14a488d4049ca3973b6a8/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:38:00.246276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe41de-0bde-4321-b8fa-38b2afadb6d5 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:00.246812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe41de-0bde-4321-b8fa-38b2afadb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:00.246812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe41de-0bde-4321-b8fa-38b2afadb6d5 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:00.248641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 574/1152] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:38:00.253763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31a2d9-1ef7-490b-a279-c2ed58ad41e7 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:00.254156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31a2d9-1ef7-490b-a279-c2ed58ad41e7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:00.254314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31a2d9-1ef7-490b-a279-c2ed58ad41e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:00.271371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8d31a2d9-1ef7-490b-a279-c2ed58ad41e7 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:38:00.272569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8d31a2d9-1ef7-490b-a279-c2ed58ad41e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:38:00.326332 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 579/1153] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:38:00 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:38:00.350358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe41de-0bde-4321-b8fa-38b2afadb6d5 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:00.363016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe41de-0bde-4321-b8fa-38b2afadb6d5 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:00.367307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d654c-b8e5-48f1-a765-7b6b5896c8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:00.368129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d654c-b8e5-48f1-a765-7b6b5896c8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:00.368414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d654c-b8e5-48f1-a765-7b6b5896c8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:00.368693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d654c-b8e5-48f1-a765-7b6b5896c8c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:00.378578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d654c-b8e5-48f1-a765-7b6b5896c8c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:38:00.385398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-f81d654c-b8e5-48f1-a765-7b6b5896c8c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:38:00.386522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 575/1154] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:38:00.392090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31a2d9-1ef7-490b-a279-c2ed58ad41e7 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:00.400730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d31a2d9-1ef7-490b-a279-c2ed58ad41e7 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:00.405686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275773b-2b2c-4333-baad-b9dba7750941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:00.406321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275773b-2b2c-4333-baad-b9dba7750941 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:00.406600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275773b-2b2c-4333-baad-b9dba7750941 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:00.406873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275773b-2b2c-4333-baad-b9dba7750941 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:00.407651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275773b-2b2c-4333-baad-b9dba7750941 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:38:00.407955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275773b-2b2c-4333-baad-b9dba7750941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:00.409532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275773b-2b2c-4333-baad-b9dba7750941 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:00.417602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 580/1155] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:00.423951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d654c-b8e5-48f1-a765-7b6b5896c8c0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:00.433879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d654c-b8e5-48f1-a765-7b6b5896c8c0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:00.438512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9f6a9-9a90-4859-b4b9-f7bf41bcf089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:00.439342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9f6a9-9a90-4859-b4b9-f7bf41bcf089 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:00.439659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9f6a9-9a90-4859-b4b9-f7bf41bcf089 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:00.439938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b9f6a9-9a90-4859-b4b9-f7bf41bcf089 admin admin] PATH_INFO: `/v3/users/a8d3b96d76f14a488d4049ca3973b6a8` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:00.441124 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9f6a9-9a90-4859-b4b9-f7bf41bcf089 admin admin] RBAC: Authorizing `identity:get_user(user_id=a8d3b96d76f14a488d4049ca3973b6a8)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:00.443229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b9f6a9-9a90-4859-b4b9-f7bf41bcf089 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:00.444820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 576/1156] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:38:00 2022] GET /identity/v3/users/a8d3b96d76f14a488d4049ca3973b6a8 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:00.449928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275773b-2b2c-4333-baad-b9dba7750941 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:00.459732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275773b-2b2c-4333-baad-b9dba7750941 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:00.464081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c3309-1d64-40fd-a587-52dcbff7db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:00.464691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c3309-1d64-40fd-a587-52dcbff7db54 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:00.464968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c3309-1d64-40fd-a587-52dcbff7db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:00.465244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c3309-1d64-40fd-a587-52dcbff7db54 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:00.473366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c3309-1d64-40fd-a587-52dcbff7db54 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:00.475057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c3309-1d64-40fd-a587-52dcbff7db54 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:00.483778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 581/1157] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:38:00 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:38:00.489006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9f6a9-9a90-4859-b4b9-f7bf41bcf089 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:00.498321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b9f6a9-9a90-4859-b4b9-f7bf41bcf089 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:00.502717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c0722-f9e6-425d-b742-36e2dc48d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:00.503546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c0722-f9e6-425d-b742-36e2dc48d83e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:00.503865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c0722-f9e6-425d-b742-36e2dc48d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:00.504147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c0722-f9e6-425d-b742-36e2dc48d83e admin admin] PATH_INFO: `/v3/projects/be849ca61ba54fd482e6cf7e734b9417` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:00.505317 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c0722-f9e6-425d-b742-36e2dc48d83e admin admin] RBAC: Authorizing `identity:get_project(project_id=be849ca61ba54fd482e6cf7e734b9417)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:00.507336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c0722-f9e6-425d-b742-36e2dc48d83e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:00.508995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 577/1158] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:38:00 2022] GET /identity/v3/projects/be849ca61ba54fd482e6cf7e734b9417 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:00.515131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c3309-1d64-40fd-a587-52dcbff7db54 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:00.523721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c3309-1d64-40fd-a587-52dcbff7db54 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:00.528135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e2b39-47da-4144-a128-d8b29c3593ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:00.528755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e2b39-47da-4144-a128-d8b29c3593ec admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:00.529036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e2b39-47da-4144-a128-d8b29c3593ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:00.529314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e2b39-47da-4144-a128-d8b29c3593ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:00.530794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e2b39-47da-4144-a128-d8b29c3593ec admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=be849ca61ba54fd482e6cf7e734b9417, user.id=a8d3b96d76f14a488d4049ca3973b6a8) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:38:00.531181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e2b39-47da-4144-a128-d8b29c3593ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:00.533011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e2b39-47da-4144-a128-d8b29c3593ec admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:00.538775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 582/1159] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:38:00 2022] GET /identity/v3/role_assignments?user.id=a8d3b96d76f14a488d4049ca3973b6a8&scope.project.id=be849ca61ba54fd482e6cf7e734b9417&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:02.815966 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6677a-731b-4174-af8c-c1d12b591ebd None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:02.816485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6677a-731b-4174-af8c-c1d12b591ebd None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:02.816485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6677a-731b-4174-af8c-c1d12b591ebd None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:02.818206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 578/1160] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:38:02.823357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba81d-5cc6-4a84-8bc6-9ac5a21d74f3 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:02.823763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba81d-5cc6-4a84-8bc6-9ac5a21d74f3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:02.823952 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba81d-5cc6-4a84-8bc6-9ac5a21d74f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:02.842247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b39ba81d-5cc6-4a84-8bc6-9ac5a21d74f3 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:38:02.843725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b39ba81d-5cc6-4a84-8bc6-9ac5a21d74f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:38:02.851330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 583/1161] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:38:02 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:38:02.875398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6677a-731b-4174-af8c-c1d12b591ebd None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:02.887284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6677a-731b-4174-af8c-c1d12b591ebd None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:02.891806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20980-ebd7-449d-bb80-cc33ff427388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:02.892431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20980-ebd7-449d-bb80-cc33ff427388 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:02.892718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20980-ebd7-449d-bb80-cc33ff427388 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:02.892998 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f20980-ebd7-449d-bb80-cc33ff427388 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:02.900416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f20980-ebd7-449d-bb80-cc33ff427388 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:02.902139 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f20980-ebd7-449d-bb80-cc33ff427388 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:02.910811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 579/1162] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:38:02 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:38:02.916564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ba81d-5cc6-4a84-8bc6-9ac5a21d74f3 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:02.925875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ba81d-5cc6-4a84-8bc6-9ac5a21d74f3 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:02.930370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c200cf9f-742f-4b87-94a4-9548d0763884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:02.931145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200cf9f-742f-4b87-94a4-9548d0763884 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:02.931431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200cf9f-742f-4b87-94a4-9548d0763884 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:02.931749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c200cf9f-742f-4b87-94a4-9548d0763884 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:02.939194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200cf9f-742f-4b87-94a4-9548d0763884 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:02.941033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c200cf9f-742f-4b87-94a4-9548d0763884 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:02.954482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-c200cf9f-742f-4b87-94a4-9548d0763884 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jan 27 16:38:02.955636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 584/1163] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:38:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:38:02.961267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20980-ebd7-449d-bb80-cc33ff427388 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:02.969944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f20980-ebd7-449d-bb80-cc33ff427388 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:02.974421 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab047e2-da4c-46ca-b085-18bb695e6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:02.975056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab047e2-da4c-46ca-b085-18bb695e6c70 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:02.975339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab047e2-da4c-46ca-b085-18bb695e6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:02.975643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab047e2-da4c-46ca-b085-18bb695e6c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:02.976395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab047e2-da4c-46ca-b085-18bb695e6c70 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:38:02.976677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab047e2-da4c-46ca-b085-18bb695e6c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:02.978229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab047e2-da4c-46ca-b085-18bb695e6c70 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:02.985851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 580/1164] 10.222.0.48 () {56 vars in 1136 bytes} [Thu Jan 27 16:38:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:05.163918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adad7e-94b4-4f3d-a429-8de3d3f9a217 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:05.164448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adad7e-94b4-4f3d-a429-8de3d3f9a217 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:05.164448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adad7e-94b4-4f3d-a429-8de3d3f9a217 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:05.166238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 585/1165] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:38:05.172034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bedae-12a7-48c1-980a-ae13ec2bf821 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:05.172436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bedae-12a7-48c1-980a-ae13ec2bf821 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:05.172599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7bedae-12a7-48c1-980a-ae13ec2bf821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:05.190211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6d7bedae-12a7-48c1-980a-ae13ec2bf821 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:38:05.191385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6d7bedae-12a7-48c1-980a-ae13ec2bf821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:38:05.198942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 581/1166] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:38:05 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:38:05.221588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adad7e-94b4-4f3d-a429-8de3d3f9a217 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:05.234313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adad7e-94b4-4f3d-a429-8de3d3f9a217 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:05.238684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954e929-0693-42e4-8cc8-8deab95261b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:05.239321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954e929-0693-42e4-8cc8-8deab95261b0 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:05.239624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954e929-0693-42e4-8cc8-8deab95261b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:05.239906 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954e929-0693-42e4-8cc8-8deab95261b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:05.240655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954e929-0693-42e4-8cc8-8deab95261b0 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:05.241670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-3954e929-0693-42e4-8cc8-8deab95261b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:38:05.241670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:38:05.241670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:38:05.242548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954e929-0693-42e4-8cc8-8deab95261b0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:05.257108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 586/1167] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Jan 27 16:38:05 2022] POST /identity/v3/domains => generated 267 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:38:07.506227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dced2-37ba-4162-b97e-40138c04604a None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:07.506808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dced2-37ba-4162-b97e-40138c04604a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:07.506808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dced2-37ba-4162-b97e-40138c04604a None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:07.508592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 582/1168] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:38:07.513664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88922-4114-4fdd-8d4d-4d31d5c50902 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:07.514106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88922-4114-4fdd-8d4d-4d31d5c50902 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:07.514210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af88922-4114-4fdd-8d4d-4d31d5c50902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:07.532057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-1af88922-4114-4fdd-8d4d-4d31d5c50902 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:38:07.533266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-1af88922-4114-4fdd-8d4d-4d31d5c50902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:38:07.588595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 587/1169] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:38:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:38:07.613246 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dced2-37ba-4162-b97e-40138c04604a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:07.625116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dced2-37ba-4162-b97e-40138c04604a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:07.629405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f4071-2ac5-4ca4-a202-98a221c757e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:07.630297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f4071-2ac5-4ca4-a202-98a221c757e8 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:07.630654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f4071-2ac5-4ca4-a202-98a221c757e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:07.630938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f4071-2ac5-4ca4-a202-98a221c757e8 admin admin] PATH_INFO: `/v3/domains/57b9dd19f91f4836a29636eb782c1039` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:07.641583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f4071-2ac5-4ca4-a202-98a221c757e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=57b9dd19f91f4836a29636eb782c1039)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:07.643545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f4071-2ac5-4ca4-a202-98a221c757e8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:07.645218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 583/1170] 10.222.0.48 () {56 vars in 1204 bytes} [Thu Jan 27 16:38:07 2022] GET /identity/v3/domains/57b9dd19f91f4836a29636eb782c1039 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:07.650928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88922-4114-4fdd-8d4d-4d31d5c50902 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:07.660244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af88922-4114-4fdd-8d4d-4d31d5c50902 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:07.664919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c45a-9444-4771-a57c-f7f552f411d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:07.665563 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c45a-9444-4771-a57c-f7f552f411d7 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:07.665849 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c45a-9444-4771-a57c-f7f552f411d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:07.666131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c45a-9444-4771-a57c-f7f552f411d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:07.666852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c45a-9444-4771-a57c-f7f552f411d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:07.668776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c45a-9444-4771-a57c-f7f552f411d7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:07.697380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 588/1171] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:38:07 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:38:09.948666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de924d-39ec-4fa1-9001-b1f3147684d1 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:09.949273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de924d-39ec-4fa1-9001-b1f3147684d1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:09.949273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de924d-39ec-4fa1-9001-b1f3147684d1 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:09.950923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 584/1172] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:38:09.956429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c049c-026c-45e4-96b6-0b6ba39515e9 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:09.956864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c049c-026c-45e4-96b6-0b6ba39515e9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:09.956988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c049c-026c-45e4-96b6-0b6ba39515e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:09.974897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-394c049c-026c-45e4-96b6-0b6ba39515e9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:38:09.976100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-394c049c-026c-45e4-96b6-0b6ba39515e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:38:10.030426 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 589/1173] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:38:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:38:10.055869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de924d-39ec-4fa1-9001-b1f3147684d1 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:10.067779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de924d-39ec-4fa1-9001-b1f3147684d1 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:10.072016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dce02a-a36f-4264-994d-38fa54cf4863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:10.072877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dce02a-a36f-4264-994d-38fa54cf4863 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:10.073159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dce02a-a36f-4264-994d-38fa54cf4863 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:10.073432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dce02a-a36f-4264-994d-38fa54cf4863 admin admin] PATH_INFO: `/v3/domains/57b9dd19f91f4836a29636eb782c1039` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:10.074608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dce02a-a36f-4264-994d-38fa54cf4863 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=57b9dd19f91f4836a29636eb782c1039)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:10.076580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dce02a-a36f-4264-994d-38fa54cf4863 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:10.078474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 585/1174] 10.222.0.48 () {56 vars in 1204 bytes} [Thu Jan 27 16:38:10 2022] GET /identity/v3/domains/57b9dd19f91f4836a29636eb782c1039 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:10.083667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c049c-026c-45e4-96b6-0b6ba39515e9 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:10.092191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c049c-026c-45e4-96b6-0b6ba39515e9 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:10.097350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4920b8-1ac5-4294-abcf-5276277b9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:10.097993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4920b8-1ac5-4294-abcf-5276277b9f8e admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:10.098273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4920b8-1ac5-4294-abcf-5276277b9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:10.098546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4920b8-1ac5-4294-abcf-5276277b9f8e admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:10.099266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4920b8-1ac5-4294-abcf-5276277b9f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:10.101190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4920b8-1ac5-4294-abcf-5276277b9f8e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:10.120959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 590/1175] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:38:10 2022] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:38:12.380193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2124ca-5376-4a92-9527-e239094c1ec7 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:12.380751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2124ca-5376-4a92-9527-e239094c1ec7 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:12.380751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2124ca-5376-4a92-9527-e239094c1ec7 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:12.382514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 586/1176] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:38:12.387591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551044f1-a46a-474e-9bd0-46db6189a41e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:12.387972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551044f1-a46a-474e-9bd0-46db6189a41e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:12.388173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551044f1-a46a-474e-9bd0-46db6189a41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:12.406498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-551044f1-a46a-474e-9bd0-46db6189a41e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:38:12.407698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-551044f1-a46a-474e-9bd0-46db6189a41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:38:12.415373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 591/1177] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:38:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:38:12.439272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2124ca-5376-4a92-9527-e239094c1ec7 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:12.451099 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2124ca-5376-4a92-9527-e239094c1ec7 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:12.456117 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5800ea5-c7eb-4684-aaf5-a851ca686c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:12.456885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5800ea5-c7eb-4684-aaf5-a851ca686c6a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:12.457172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5800ea5-c7eb-4684-aaf5-a851ca686c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:12.457453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5800ea5-c7eb-4684-aaf5-a851ca686c6a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:12.468517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5800ea5-c7eb-4684-aaf5-a851ca686c6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:38:12.475240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-e5800ea5-c7eb-4684-aaf5-a851ca686c6a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:38:12.476389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 587/1178] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:38:12.481876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551044f1-a46a-474e-9bd0-46db6189a41e None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:12.490594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551044f1-a46a-474e-9bd0-46db6189a41e None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:12.494952 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e949179-c727-45c7-82dd-35fbd8c09f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:12.495621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e949179-c727-45c7-82dd-35fbd8c09f85 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:12.495905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e949179-c727-45c7-82dd-35fbd8c09f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:12.496180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e949179-c727-45c7-82dd-35fbd8c09f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:12.496935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e949179-c727-45c7-82dd-35fbd8c09f85 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:38:12.497237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e949179-c727-45c7-82dd-35fbd8c09f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:12.498955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e949179-c727-45c7-82dd-35fbd8c09f85 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:12.507014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 592/1179] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:38:12.512512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5800ea5-c7eb-4684-aaf5-a851ca686c6a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:12.522446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5800ea5-c7eb-4684-aaf5-a851ca686c6a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:12.526877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54311300-5fdc-4e7d-9c60-b239c2c466a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:12.527795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54311300-5fdc-4e7d-9c60-b239c2c466a7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:12.528081 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54311300-5fdc-4e7d-9c60-b239c2c466a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:12.528359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54311300-5fdc-4e7d-9c60-b239c2c466a7 admin admin] PATH_INFO: `/v3/users/825e61948e254ea182d70a6876b0c12d` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:12.541609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54311300-5fdc-4e7d-9c60-b239c2c466a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=825e61948e254ea182d70a6876b0c12d)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:12.543769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54311300-5fdc-4e7d-9c60-b239c2c466a7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:12.545379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 588/1180] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:38:12 2022] GET /identity/v3/users/825e61948e254ea182d70a6876b0c12d => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:12.551419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e949179-c727-45c7-82dd-35fbd8c09f85 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:12.560884 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e949179-c727-45c7-82dd-35fbd8c09f85 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:12.565897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4a53-a577-49a8-a95d-98b8a9c8eb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:12.566537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4a53-a577-49a8-a95d-98b8a9c8eb1a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:12.566813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4a53-a577-49a8-a95d-98b8a9c8eb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:12.567089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c4a53-a577-49a8-a95d-98b8a9c8eb1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:12.574575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c4a53-a577-49a8-a95d-98b8a9c8eb1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:12.576353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427c4a53-a577-49a8-a95d-98b8a9c8eb1a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:12.584950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 593/1181] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:38:12 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:38:12.590459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54311300-5fdc-4e7d-9c60-b239c2c466a7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:12.599878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54311300-5fdc-4e7d-9c60-b239c2c466a7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:12.604287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cadec9-9551-47cd-bc06-ec69c528efed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:12.605122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cadec9-9551-47cd-bc06-ec69c528efed admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:12.605406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cadec9-9551-47cd-bc06-ec69c528efed admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:12.605684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cadec9-9551-47cd-bc06-ec69c528efed admin admin] PATH_INFO: `/v3/projects/389a1c8175fc424893621250049a3f1c` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:12.606850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cadec9-9551-47cd-bc06-ec69c528efed admin admin] RBAC: Authorizing `identity:get_project(project_id=389a1c8175fc424893621250049a3f1c)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:12.609481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cadec9-9551-47cd-bc06-ec69c528efed admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:12.611085 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 589/1182] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:38:12 2022] GET /identity/v3/projects/389a1c8175fc424893621250049a3f1c => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:12.616725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4a53-a577-49a8-a95d-98b8a9c8eb1a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:12.626187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c4a53-a577-49a8-a95d-98b8a9c8eb1a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:12.630646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143513c-e25a-4309-ab0b-ee456e408729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:12.631209 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143513c-e25a-4309-ab0b-ee456e408729 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:12.631488 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143513c-e25a-4309-ab0b-ee456e408729 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:12.631794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143513c-e25a-4309-ab0b-ee456e408729 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:12.632616 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143513c-e25a-4309-ab0b-ee456e408729 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=389a1c8175fc424893621250049a3f1c, user.id=825e61948e254ea182d70a6876b0c12d) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:38:12.632925 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143513c-e25a-4309-ab0b-ee456e408729 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:12.634833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143513c-e25a-4309-ab0b-ee456e408729 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:12.640498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 594/1183] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:38:12 2022] GET /identity/v3/role_assignments?user.id=825e61948e254ea182d70a6876b0c12d&scope.project.id=389a1c8175fc424893621250049a3f1c&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:14.808490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea55c-cace-48d2-a9d8-c031020aac27 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:14.809003 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea55c-cace-48d2-a9d8-c031020aac27 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:14.809003 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eea55c-cace-48d2-a9d8-c031020aac27 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:14.810742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 590/1184] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:38:14.816490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5711a9-9e2d-4a53-b9b6-297424c78aa9 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:14.816917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5711a9-9e2d-4a53-b9b6-297424c78aa9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:14.817044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5711a9-9e2d-4a53-b9b6-297424c78aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:14.834526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-dd5711a9-9e2d-4a53-b9b6-297424c78aa9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:38:14.835715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-dd5711a9-9e2d-4a53-b9b6-297424c78aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:38:14.843670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 595/1185] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:38:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:38:14.866941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eea55c-cace-48d2-a9d8-c031020aac27 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:14.879281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eea55c-cace-48d2-a9d8-c031020aac27 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:14.883535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ffea-d660-46bc-ae9a-0db31a2b29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:14.884325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ffea-d660-46bc-ae9a-0db31a2b29e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:14.884612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ffea-d660-46bc-ae9a-0db31a2b29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:14.884891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2ffea-d660-46bc-ae9a-0db31a2b29e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:14.894736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2ffea-d660-46bc-ae9a-0db31a2b29e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:38:14.901488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-b8f2ffea-d660-46bc-ae9a-0db31a2b29e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:38:14.902614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 591/1186] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:38:14.908436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5711a9-9e2d-4a53-b9b6-297424c78aa9 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:14.917310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5711a9-9e2d-4a53-b9b6-297424c78aa9 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:14.922296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1572d9c-853a-404d-82ae-de96e79f6639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:14.922936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1572d9c-853a-404d-82ae-de96e79f6639 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:14.923221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1572d9c-853a-404d-82ae-de96e79f6639 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:14.923495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1572d9c-853a-404d-82ae-de96e79f6639 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:14.924269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1572d9c-853a-404d-82ae-de96e79f6639 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:38:14.924573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1572d9c-853a-404d-82ae-de96e79f6639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:14.926133 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1572d9c-853a-404d-82ae-de96e79f6639 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:14.934035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 596/1187] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:14.940063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ffea-d660-46bc-ae9a-0db31a2b29e2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:14.949809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2ffea-d660-46bc-ae9a-0db31a2b29e2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:14.954324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206cc7d-fe4d-47ab-b08a-eaa23ea931dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:14.955145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206cc7d-fe4d-47ab-b08a-eaa23ea931dd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:14.955430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206cc7d-fe4d-47ab-b08a-eaa23ea931dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:14.955744 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206cc7d-fe4d-47ab-b08a-eaa23ea931dd admin admin] PATH_INFO: `/v3/users/825e61948e254ea182d70a6876b0c12d` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:14.956919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206cc7d-fe4d-47ab-b08a-eaa23ea931dd admin admin] RBAC: Authorizing `identity:get_user(user_id=825e61948e254ea182d70a6876b0c12d)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:14.959000 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206cc7d-fe4d-47ab-b08a-eaa23ea931dd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:14.960574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 592/1188] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:38:14 2022] GET /identity/v3/users/825e61948e254ea182d70a6876b0c12d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:14.965645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1572d9c-853a-404d-82ae-de96e79f6639 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:14.974772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1572d9c-853a-404d-82ae-de96e79f6639 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:14.979102 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29581aef-d8e9-4762-9197-82aefaf9f3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:14.979954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581aef-d8e9-4762-9197-82aefaf9f3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:14.980236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581aef-d8e9-4762-9197-82aefaf9f3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:14.980506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29581aef-d8e9-4762-9197-82aefaf9f3e5 admin admin] PATH_INFO: `/v3/projects/389a1c8175fc424893621250049a3f1c` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:14.981652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581aef-d8e9-4762-9197-82aefaf9f3e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=389a1c8175fc424893621250049a3f1c)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:14.984292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29581aef-d8e9-4762-9197-82aefaf9f3e5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:14.985877 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 597/1189] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:38:14 2022] GET /identity/v3/projects/389a1c8175fc424893621250049a3f1c => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:14.991115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206cc7d-fe4d-47ab-b08a-eaa23ea931dd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:15.001053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206cc7d-fe4d-47ab-b08a-eaa23ea931dd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:15.005491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f7b1a-6abd-4130-b18b-977398449771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:15.006336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f7b1a-6abd-4130-b18b-977398449771 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:15.006624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f7b1a-6abd-4130-b18b-977398449771 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:15.006907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f7b1a-6abd-4130-b18b-977398449771 admin admin] PATH_INFO: `/v3/projects/389a1c8175fc424893621250049a3f1c/users/825e61948e254ea182d70a6876b0c12d/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:15.008878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f7b1a-6abd-4130-b18b-977398449771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389a1c8175fc424893621250049a3f1c, user_id=825e61948e254ea182d70a6876b0c12d, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:15.011480 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f7b1a-6abd-4130-b18b-977398449771 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:15.023661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 593/1190] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:38:14 2022] PUT /identity/v3/projects/389a1c8175fc424893621250049a3f1c/users/825e61948e254ea182d70a6876b0c12d/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:38:17.169561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb610995-16ab-4984-ba42-0d823388815e None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:17.170101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb610995-16ab-4984-ba42-0d823388815e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:17.170101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb610995-16ab-4984-ba42-0d823388815e None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:17.172468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 598/1191] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:38:17.177566 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c068b-9554-4285-a375-c6ba34011b8a None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:17.178014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c068b-9554-4285-a375-c6ba34011b8a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:17.178130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c068b-9554-4285-a375-c6ba34011b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:17.197317 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a42c068b-9554-4285-a375-c6ba34011b8a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:38:17.198490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a42c068b-9554-4285-a375-c6ba34011b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:38:17.252844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 594/1192] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:38:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:38:17.276921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb610995-16ab-4984-ba42-0d823388815e None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:17.289785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb610995-16ab-4984-ba42-0d823388815e None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:17.294091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d788e-411c-4a59-bf0b-6c30552dad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:17.294859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d788e-411c-4a59-bf0b-6c30552dad0e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:17.295148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d788e-411c-4a59-bf0b-6c30552dad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:17.295457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d788e-411c-4a59-bf0b-6c30552dad0e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:17.306086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d788e-411c-4a59-bf0b-6c30552dad0e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:38:17.313172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-ea6d788e-411c-4a59-bf0b-6c30552dad0e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:38:17.314310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 599/1193] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:38:17.319993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c068b-9554-4285-a375-c6ba34011b8a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:17.328960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c068b-9554-4285-a375-c6ba34011b8a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:17.333399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8afc-bd3f-41ff-8720-588858665463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:17.334051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8afc-bd3f-41ff-8720-588858665463 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:17.334337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8afc-bd3f-41ff-8720-588858665463 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:17.334615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c8afc-bd3f-41ff-8720-588858665463 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:17.335379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8afc-bd3f-41ff-8720-588858665463 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:38:17.335723 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8afc-bd3f-41ff-8720-588858665463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:17.337341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51c8afc-bd3f-41ff-8720-588858665463 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:17.345959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 595/1194] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:17.351425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d788e-411c-4a59-bf0b-6c30552dad0e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:17.361946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d788e-411c-4a59-bf0b-6c30552dad0e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:17.366377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571d710-4715-4a52-80ee-4cd18340536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:17.367202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571d710-4715-4a52-80ee-4cd18340536c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:17.367484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571d710-4715-4a52-80ee-4cd18340536c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:17.367788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571d710-4715-4a52-80ee-4cd18340536c admin admin] PATH_INFO: `/v3/users/825e61948e254ea182d70a6876b0c12d` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:17.368971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571d710-4715-4a52-80ee-4cd18340536c admin admin] RBAC: Authorizing `identity:get_user(user_id=825e61948e254ea182d70a6876b0c12d)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:17.371114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571d710-4715-4a52-80ee-4cd18340536c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:17.372702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 600/1195] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jan 27 16:38:17 2022] GET /identity/v3/users/825e61948e254ea182d70a6876b0c12d => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:38:17.377830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8afc-bd3f-41ff-8720-588858665463 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:17.387066 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c8afc-bd3f-41ff-8720-588858665463 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:17.391593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a658b4-27da-4177-8e3b-bfc9f91376ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:17.392210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a658b4-27da-4177-8e3b-bfc9f91376ff admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:17.392488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a658b4-27da-4177-8e3b-bfc9f91376ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:17.392762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a658b4-27da-4177-8e3b-bfc9f91376ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:17.400173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a658b4-27da-4177-8e3b-bfc9f91376ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:17.401861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a658b4-27da-4177-8e3b-bfc9f91376ff admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:17.411026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 596/1196] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:38:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:38:17.416464 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571d710-4715-4a52-80ee-4cd18340536c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:17.426642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571d710-4715-4a52-80ee-4cd18340536c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:17.431018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba0df8-d44a-43f7-aea8-786f92b63ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:17.431855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba0df8-d44a-43f7-aea8-786f92b63ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:17.432141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba0df8-d44a-43f7-aea8-786f92b63ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:17.432420 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba0df8-d44a-43f7-aea8-786f92b63ab6 admin admin] PATH_INFO: `/v3/projects/389a1c8175fc424893621250049a3f1c` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:17.433591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba0df8-d44a-43f7-aea8-786f92b63ab6 admin admin] RBAC: Authorizing `identity:get_project(project_id=389a1c8175fc424893621250049a3f1c)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:17.435615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba0df8-d44a-43f7-aea8-786f92b63ab6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:17.437276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 601/1197] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:38:17 2022] GET /identity/v3/projects/389a1c8175fc424893621250049a3f1c => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:38:17.442631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a658b4-27da-4177-8e3b-bfc9f91376ff admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:38:17.450919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a658b4-27da-4177-8e3b-bfc9f91376ff admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:38:17.455316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e0559-53b1-43c8-b946-81349e4f3b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:38:17.455952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0559-53b1-43c8-b946-81349e4f3b8c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:38:17.456234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0559-53b1-43c8-b946-81349e4f3b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:38:17.456509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e0559-53b1-43c8-b946-81349e4f3b8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:38:17.457316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0559-53b1-43c8-b946-81349e4f3b8c admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=389a1c8175fc424893621250049a3f1c, user.id=825e61948e254ea182d70a6876b0c12d) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:38:17.457621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0559-53b1-43c8-b946-81349e4f3b8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:38:17.459402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e0559-53b1-43c8-b946-81349e4f3b8c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:38:17.464873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 597/1198] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:38:17 2022] GET /identity/v3/role_assignments?user.id=825e61948e254ea182d70a6876b0c12d&scope.project.id=389a1c8175fc424893621250049a3f1c&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:18.479683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49773467-fbd3-4394-a20d-288fd01e9ea2 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:18.479683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49773467-fbd3-4394-a20d-288fd01e9ea2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:18.479683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49773467-fbd3-4394-a20d-288fd01e9ea2 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:18.479683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 602/1199] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:18.487083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24910dda-984b-47fc-8ab4-9f6542e07df1 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:18.487553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24910dda-984b-47fc-8ab4-9f6542e07df1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:18.487753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24910dda-984b-47fc-8ab4-9f6542e07df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:18.510323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-24910dda-984b-47fc-8ab4-9f6542e07df1 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:18.511842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-24910dda-984b-47fc-8ab4-9f6542e07df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:18.521375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 598/1200] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:39:18.552785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49773467-fbd3-4394-a20d-288fd01e9ea2 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:18.577726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49773467-fbd3-4394-a20d-288fd01e9ea2 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:18.583822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1853a-4380-461a-a691-7a12562abead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:18.584770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1853a-4380-461a-a691-7a12562abead admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:18.585159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1853a-4380-461a-a691-7a12562abead admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:18.585511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1853a-4380-461a-a691-7a12562abead admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:18.597564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1853a-4380-461a-a691-7a12562abead admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:18.599401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1853a-4380-461a-a691-7a12562abead admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:18.621139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-a9c1853a-4380-461a-a691-7a12562abead admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:18.622377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 603/1201] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:39:18.630386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24910dda-984b-47fc-8ab4-9f6542e07df1 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:18.642023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24910dda-984b-47fc-8ab4-9f6542e07df1 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:18.648127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e5ee0-57e1-4182-b58f-0da27c9f5191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:18.648944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e5ee0-57e1-4182-b58f-0da27c9f5191 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:18.649384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e5ee0-57e1-4182-b58f-0da27c9f5191 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:18.649762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e5ee0-57e1-4182-b58f-0da27c9f5191 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:18.650784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e5ee0-57e1-4182-b58f-0da27c9f5191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:18.651300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e5ee0-57e1-4182-b58f-0da27c9f5191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:18.653742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e5ee0-57e1-4182-b58f-0da27c9f5191 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:18.672770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 599/1202] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:18.678712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1853a-4380-461a-a691-7a12562abead admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:18.691743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1853a-4380-461a-a691-7a12562abead admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:18.698184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb043f-d011-4219-84e9-0ae8646ba1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:18.700832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb043f-d011-4219-84e9-0ae8646ba1da admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:18.701583 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb043f-d011-4219-84e9-0ae8646ba1da admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:18.702199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb043f-d011-4219-84e9-0ae8646ba1da admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:18.703267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb043f-d011-4219-84e9-0ae8646ba1da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:18.705646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb043f-d011-4219-84e9-0ae8646ba1da admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:18.738244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 604/1203] 10.222.0.48 () {60 vars in 1153 bytes} [Thu Jan 27 16:39:18 2022] POST /identity/v3/users => generated 251 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:39:21.303039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3f438-64b4-4583-a0e5-a2f6151448a0 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.303683 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3f438-64b4-4583-a0e5-a2f6151448a0 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.303683 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3f438-64b4-4583-a0e5-a2f6151448a0 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.305492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 600/1204] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:21.312346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d7df1-3091-4296-aaac-75260bb553a4 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.312960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d7df1-3091-4296-aaac-75260bb553a4 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.312960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d7df1-3091-4296-aaac-75260bb553a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.333955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-9a7d7df1-3091-4296-aaac-75260bb553a4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:21.335715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9a7d7df1-3091-4296-aaac-75260bb553a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:21.345164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 605/1205] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:39:21.371307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3f438-64b4-4583-a0e5-a2f6151448a0 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.389366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb3f438-64b4-4583-a0e5-a2f6151448a0 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.396082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99afbb1-dc3c-4d9d-a891-6f0999ed821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.396922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99afbb1-dc3c-4d9d-a891-6f0999ed821e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.397249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99afbb1-dc3c-4d9d-a891-6f0999ed821e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.397483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99afbb1-dc3c-4d9d-a891-6f0999ed821e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.409679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99afbb1-dc3c-4d9d-a891-6f0999ed821e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:39:21.417150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-f99afbb1-dc3c-4d9d-a891-6f0999ed821e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:39:21.418568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 601/1206] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:21.424547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d7df1-3091-4296-aaac-75260bb553a4 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.433589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d7df1-3091-4296-aaac-75260bb553a4 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.439400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5ec5b-06de-4420-b8e7-3b9691e35f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.440151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5ec5b-06de-4420-b8e7-3b9691e35f3a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.440448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5ec5b-06de-4420-b8e7-3b9691e35f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.440782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5ec5b-06de-4420-b8e7-3b9691e35f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.441589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5ec5b-06de-4420-b8e7-3b9691e35f3a admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:21.442003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5ec5b-06de-4420-b8e7-3b9691e35f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.443688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5ec5b-06de-4420-b8e7-3b9691e35f3a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.453154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 606/1207] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:21.458521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99afbb1-dc3c-4d9d-a891-6f0999ed821e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.469095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99afbb1-dc3c-4d9d-a891-6f0999ed821e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.474336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d40673-622b-4dda-929f-38d6cad6a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.475023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d40673-622b-4dda-929f-38d6cad6a8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.475306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d40673-622b-4dda-929f-38d6cad6a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.475597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d40673-622b-4dda-929f-38d6cad6a8b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.486957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d40673-622b-4dda-929f-38d6cad6a8b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.488901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d40673-622b-4dda-929f-38d6cad6a8b0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.506364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-66d40673-622b-4dda-929f-38d6cad6a8b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:21.507750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 602/1208] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:39:21.513515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5ec5b-06de-4420-b8e7-3b9691e35f3a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.523452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5ec5b-06de-4420-b8e7-3b9691e35f3a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.528633 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5179c-c600-431f-be0f-d7de1a405449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.529791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5179c-c600-431f-be0f-d7de1a405449 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.530074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5179c-c600-431f-be0f-d7de1a405449 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.530363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5179c-c600-431f-be0f-d7de1a405449 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.531170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5179c-c600-431f-be0f-d7de1a405449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:21.531483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5179c-c600-431f-be0f-d7de1a405449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.533247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5179c-c600-431f-be0f-d7de1a405449 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.549356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 607/1209] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:39:21.555204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d40673-622b-4dda-929f-38d6cad6a8b0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.566028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d40673-622b-4dda-929f-38d6cad6a8b0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.570748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f26d1-2e48-4b19-a8fa-a8e243db6eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.571548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f26d1-2e48-4b19-a8fa-a8e243db6eaf admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.571860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f26d1-2e48-4b19-a8fa-a8e243db6eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.572142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f26d1-2e48-4b19-a8fa-a8e243db6eaf admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.580459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f26d1-2e48-4b19-a8fa-a8e243db6eaf admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.582559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f26d1-2e48-4b19-a8fa-a8e243db6eaf admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.598334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-f85f26d1-2e48-4b19-a8fa-a8e243db6eaf admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 27 16:39:21.604374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 603/1210] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:21.605377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5179c-c600-431f-be0f-d7de1a405449 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.616296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5179c-c600-431f-be0f-d7de1a405449 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.621465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c77503-4381-4afb-8f85-26b64f33e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.622212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77503-4381-4afb-8f85-26b64f33e1ab admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.622615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77503-4381-4afb-8f85-26b64f33e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.622914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77503-4381-4afb-8f85-26b64f33e1ab admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.624053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c77503-4381-4afb-8f85-26b64f33e1ab admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:21.624432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c77503-4381-4afb-8f85-26b64f33e1ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.626318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c77503-4381-4afb-8f85-26b64f33e1ab admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.645462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 608/1211] 10.222.0.48 () {56 vars in 1164 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:21.651408 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f26d1-2e48-4b19-a8fa-a8e243db6eaf admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.662760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f26d1-2e48-4b19-a8fa-a8e243db6eaf admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.667996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805c96f-617b-4d96-9358-987615605651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.668876 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c96f-617b-4d96-9358-987615605651 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.669187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c96f-617b-4d96-9358-987615605651 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.669525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805c96f-617b-4d96-9358-987615605651 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.678408 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805c96f-617b-4d96-9358-987615605651 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.680190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805c96f-617b-4d96-9358-987615605651 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.689935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 604/1212] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:39:21.695708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c77503-4381-4afb-8f85-26b64f33e1ab admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.706225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c77503-4381-4afb-8f85-26b64f33e1ab admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.711015 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61de81-8891-4d59-9d7c-4104fb76eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.711868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61de81-8891-4d59-9d7c-4104fb76eb25 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.712122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61de81-8891-4d59-9d7c-4104fb76eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.712414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61de81-8891-4d59-9d7c-4104fb76eb25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.723393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61de81-8891-4d59-9d7c-4104fb76eb25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.725362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61de81-8891-4d59-9d7c-4104fb76eb25 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.742109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-ad61de81-8891-4d59-9d7c-4104fb76eb25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:21.743456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 609/1213] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:21.749828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805c96f-617b-4d96-9358-987615605651 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.758769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805c96f-617b-4d96-9358-987615605651 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.764313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c243e2a-92a2-458c-a00e-6f65f8eb447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.764973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c243e2a-92a2-458c-a00e-6f65f8eb447f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.765260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c243e2a-92a2-458c-a00e-6f65f8eb447f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.765542 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c243e2a-92a2-458c-a00e-6f65f8eb447f admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.766274 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c243e2a-92a2-458c-a00e-6f65f8eb447f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:21.766583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c243e2a-92a2-458c-a00e-6f65f8eb447f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.768207 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c243e2a-92a2-458c-a00e-6f65f8eb447f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.781003 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 605/1214] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:21.787098 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61de81-8891-4d59-9d7c-4104fb76eb25 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.798123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61de81-8891-4d59-9d7c-4104fb76eb25 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.803293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f796b-0813-449b-9294-14174fc5c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.804117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f796b-0813-449b-9294-14174fc5c561 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.806442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f796b-0813-449b-9294-14174fc5c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.806442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f796b-0813-449b-9294-14174fc5c561 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.812930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f796b-0813-449b-9294-14174fc5c561 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.815087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f796b-0813-449b-9294-14174fc5c561 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.829461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-769f796b-0813-449b-9294-14174fc5c561 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:39:21.830910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 610/1215] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:21.836917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c243e2a-92a2-458c-a00e-6f65f8eb447f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.847192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c243e2a-92a2-458c-a00e-6f65f8eb447f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.852587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb17379-41c7-4b48-b16d-e473710b4726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.853253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17379-41c7-4b48-b16d-e473710b4726 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.853546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17379-41c7-4b48-b16d-e473710b4726 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.853836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17379-41c7-4b48-b16d-e473710b4726 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.854631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17379-41c7-4b48-b16d-e473710b4726 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:21.854948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17379-41c7-4b48-b16d-e473710b4726 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.857421 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17379-41c7-4b48-b16d-e473710b4726 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.871606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 606/1216] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:21.877976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f796b-0813-449b-9294-14174fc5c561 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:21.890542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f796b-0813-449b-9294-14174fc5c561 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:21.896091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19104fd5-5d73-4120-b9ec-daa33e40f8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:21.896807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104fd5-5d73-4120-b9ec-daa33e40f8fa admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:21.897160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104fd5-5d73-4120-b9ec-daa33e40f8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:21.897409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19104fd5-5d73-4120-b9ec-daa33e40f8fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:21.898408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19104fd5-5d73-4120-b9ec-daa33e40f8fa admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=6f5bbcf690d144ab99438b3f65b5e100) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:21.898690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19104fd5-5d73-4120-b9ec-daa33e40f8fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:21.900754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19104fd5-5d73-4120-b9ec-daa33e40f8fa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:21.907612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 611/1217] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:39:21 2022] GET /identity/v3/role_assignments?user.id=6f5bbcf690d144ab99438b3f65b5e100&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:24.276950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36a6e0-9222-4394-9f3a-107ca753e719 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.277486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36a6e0-9222-4394-9f3a-107ca753e719 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.277486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36a6e0-9222-4394-9f3a-107ca753e719 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.279934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 607/1218] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:24.286960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108fec6-98e0-4ea7-b8cb-310e0ba9f140 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.287468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108fec6-98e0-4ea7-b8cb-310e0ba9f140 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.287620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108fec6-98e0-4ea7-b8cb-310e0ba9f140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.309245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-6108fec6-98e0-4ea7-b8cb-310e0ba9f140 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:24.310829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6108fec6-98e0-4ea7-b8cb-310e0ba9f140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:24.320015 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 612/1219] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:39:24.347228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36a6e0-9222-4394-9f3a-107ca753e719 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.362044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36a6e0-9222-4394-9f3a-107ca753e719 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.366954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97310117-1046-4bc8-bb8f-a2dedb7160f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.367861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97310117-1046-4bc8-bb8f-a2dedb7160f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.368158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97310117-1046-4bc8-bb8f-a2dedb7160f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.368418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97310117-1046-4bc8-bb8f-a2dedb7160f1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.379256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97310117-1046-4bc8-bb8f-a2dedb7160f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:39:24.387862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-97310117-1046-4bc8-bb8f-a2dedb7160f1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:39:24.395889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 608/1220] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:24.397451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108fec6-98e0-4ea7-b8cb-310e0ba9f140 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.408771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6108fec6-98e0-4ea7-b8cb-310e0ba9f140 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.414315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde4df-0833-49ce-8dc3-570b253fe115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.414980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde4df-0833-49ce-8dc3-570b253fe115 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.415369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde4df-0833-49ce-8dc3-570b253fe115 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.415682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bde4df-0833-49ce-8dc3-570b253fe115 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.416437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde4df-0833-49ce-8dc3-570b253fe115 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:24.416740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde4df-0833-49ce-8dc3-570b253fe115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.418327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bde4df-0833-49ce-8dc3-570b253fe115 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.426988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 613/1221] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:39:24.432691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97310117-1046-4bc8-bb8f-a2dedb7160f1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.445112 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97310117-1046-4bc8-bb8f-a2dedb7160f1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.449577 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f763d3d-5084-47ed-85d3-b1bda2ff44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.450361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f763d3d-5084-47ed-85d3-b1bda2ff44cf admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.450811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f763d3d-5084-47ed-85d3-b1bda2ff44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.451147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f763d3d-5084-47ed-85d3-b1bda2ff44cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.461706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f763d3d-5084-47ed-85d3-b1bda2ff44cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.463868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f763d3d-5084-47ed-85d3-b1bda2ff44cf admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.483659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-5f763d3d-5084-47ed-85d3-b1bda2ff44cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:24.484855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 609/1222] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:24.490946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde4df-0833-49ce-8dc3-570b253fe115 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.506530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bde4df-0833-49ce-8dc3-570b253fe115 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.511660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cccd8-73f9-46d8-9608-36bf48aba4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.512322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cccd8-73f9-46d8-9608-36bf48aba4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.512607 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cccd8-73f9-46d8-9608-36bf48aba4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.512920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cccd8-73f9-46d8-9608-36bf48aba4c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.514509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cccd8-73f9-46d8-9608-36bf48aba4c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:24.514898 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cccd8-73f9-46d8-9608-36bf48aba4c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.516872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cccd8-73f9-46d8-9608-36bf48aba4c6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.531807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 614/1223] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:24.538859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f763d3d-5084-47ed-85d3-b1bda2ff44cf admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.551267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f763d3d-5084-47ed-85d3-b1bda2ff44cf admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.557093 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61f980-6819-4050-8a77-df4714c04eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.557976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f980-6819-4050-8a77-df4714c04eea admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.558366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f980-6819-4050-8a77-df4714c04eea admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.558722 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61f980-6819-4050-8a77-df4714c04eea admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.567626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61f980-6819-4050-8a77-df4714c04eea admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.569834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61f980-6819-4050-8a77-df4714c04eea admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.588215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-8f61f980-6819-4050-8a77-df4714c04eea admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 27 16:39:24.591596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 610/1224] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:24.596121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cccd8-73f9-46d8-9608-36bf48aba4c6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.606858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cccd8-73f9-46d8-9608-36bf48aba4c6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.611880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a25afd-c430-42b7-b137-e8a124aa9130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.612547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a25afd-c430-42b7-b137-e8a124aa9130 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.612832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a25afd-c430-42b7-b137-e8a124aa9130 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.613118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a25afd-c430-42b7-b137-e8a124aa9130 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.614073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a25afd-c430-42b7-b137-e8a124aa9130 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:24.614386 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a25afd-c430-42b7-b137-e8a124aa9130 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.616429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a25afd-c430-42b7-b137-e8a124aa9130 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.635698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 615/1225] 10.222.0.48 () {56 vars in 1164 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:24.642293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61f980-6819-4050-8a77-df4714c04eea admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.652718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61f980-6819-4050-8a77-df4714c04eea admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.658035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ea6f4-a6c3-4880-863f-ee2eb5003769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.659007 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea6f4-a6c3-4880-863f-ee2eb5003769 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.659258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea6f4-a6c3-4880-863f-ee2eb5003769 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.659547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ea6f4-a6c3-4880-863f-ee2eb5003769 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.671402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ea6f4-a6c3-4880-863f-ee2eb5003769 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.673313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ea6f4-a6c3-4880-863f-ee2eb5003769 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.691372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-886ea6f4-a6c3-4880-863f-ee2eb5003769 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:24.692898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 611/1226] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:39:24.698794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a25afd-c430-42b7-b137-e8a124aa9130 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.710253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a25afd-c430-42b7-b137-e8a124aa9130 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.715181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7085e3d-3d1b-49be-b649-a8e7c416f0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.715887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7085e3d-3d1b-49be-b649-a8e7c416f0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.716317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7085e3d-3d1b-49be-b649-a8e7c416f0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.716710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7085e3d-3d1b-49be-b649-a8e7c416f0b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.717770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7085e3d-3d1b-49be-b649-a8e7c416f0b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:24.718124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7085e3d-3d1b-49be-b649-a8e7c416f0b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.719845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7085e3d-3d1b-49be-b649-a8e7c416f0b3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.735871 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 616/1227] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:24.740907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ea6f4-a6c3-4880-863f-ee2eb5003769 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.752813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ea6f4-a6c3-4880-863f-ee2eb5003769 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.758184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6df0-2527-4fc5-bee6-8c4950835cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.759153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6df0-2527-4fc5-bee6-8c4950835cfd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.759680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6df0-2527-4fc5-bee6-8c4950835cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.760171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e6df0-2527-4fc5-bee6-8c4950835cfd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.768456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e6df0-2527-4fc5-bee6-8c4950835cfd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.770618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314e6df0-2527-4fc5-bee6-8c4950835cfd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.785533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-314e6df0-2527-4fc5-bee6-8c4950835cfd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:39:24.787354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 612/1228] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:24.793711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7085e3d-3d1b-49be-b649-a8e7c416f0b3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.805294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7085e3d-3d1b-49be-b649-a8e7c416f0b3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.810026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b6c76-14a2-4a0d-8d57-6bd9fa37bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.811329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6c76-14a2-4a0d-8d57-6bd9fa37bfd7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.811787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6c76-14a2-4a0d-8d57-6bd9fa37bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.812142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b6c76-14a2-4a0d-8d57-6bd9fa37bfd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.813021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6c76-14a2-4a0d-8d57-6bd9fa37bfd7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:24.813400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6c76-14a2-4a0d-8d57-6bd9fa37bfd7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.815330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b6c76-14a2-4a0d-8d57-6bd9fa37bfd7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.833616 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 617/1229] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:24.834704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6df0-2527-4fc5-bee6-8c4950835cfd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:24.847067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e6df0-2527-4fc5-bee6-8c4950835cfd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:24.852903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb772c1-8dd9-4849-8b64-933dfef56be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:24.853908 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb772c1-8dd9-4849-8b64-933dfef56be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:24.854245 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb772c1-8dd9-4849-8b64-933dfef56be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:24.854546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb772c1-8dd9-4849-8b64-933dfef56be8 admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/6f5bbcf690d144ab99438b3f65b5e100/roles/a22d2094a5364a8ba169d8e80f4402c5` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:24.874433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb772c1-8dd9-4849-8b64-933dfef56be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=6f5bbcf690d144ab99438b3f65b5e100, role_id=a22d2094a5364a8ba169d8e80f4402c5)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:24.877464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb772c1-8dd9-4849-8b64-933dfef56be8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:24.892411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 613/1230] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:39:24 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/6f5bbcf690d144ab99438b3f65b5e100/roles/a22d2094a5364a8ba169d8e80f4402c5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:39:27.345335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c181f-3774-46e1-b3aa-9a7035753940 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.345890 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c181f-3774-46e1-b3aa-9a7035753940 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.345890 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c181f-3774-46e1-b3aa-9a7035753940 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.347700 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 618/1231] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:27.353128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e0129-f09a-4497-ae3e-ea4d79414a6a None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.353600 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e0129-f09a-4497-ae3e-ea4d79414a6a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.353752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e0129-f09a-4497-ae3e-ea4d79414a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.375827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-7c8e0129-f09a-4497-ae3e-ea4d79414a6a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:27.377034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7c8e0129-f09a-4497-ae3e-ea4d79414a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:27.443121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 614/1232] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:39:27.470423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c181f-3774-46e1-b3aa-9a7035753940 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.484668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c181f-3774-46e1-b3aa-9a7035753940 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.490329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623af0f9-d553-4eb1-b763-5a879c82e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.491115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623af0f9-d553-4eb1-b763-5a879c82e443 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.491397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623af0f9-d553-4eb1-b763-5a879c82e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.491736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623af0f9-d553-4eb1-b763-5a879c82e443 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.503951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623af0f9-d553-4eb1-b763-5a879c82e443 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:39:27.510906 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-623af0f9-d553-4eb1-b763-5a879c82e443 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jan 27 16:39:27.512141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 619/1233] 10.222.0.48 () {56 vars in 1123 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:39:27.518864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e0129-f09a-4497-ae3e-ea4d79414a6a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.527727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e0129-f09a-4497-ae3e-ea4d79414a6a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.532962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333c3f8-5eca-4d1e-8a40-73e470645672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.533624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333c3f8-5eca-4d1e-8a40-73e470645672 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.533936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333c3f8-5eca-4d1e-8a40-73e470645672 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.534187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333c3f8-5eca-4d1e-8a40-73e470645672 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.534947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333c3f8-5eca-4d1e-8a40-73e470645672 admin admin] RBAC: Adding query filter params (name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:27.535289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333c3f8-5eca-4d1e-8a40-73e470645672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.537133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333c3f8-5eca-4d1e-8a40-73e470645672 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.545574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 615/1234] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:27.551700 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623af0f9-d553-4eb1-b763-5a879c82e443 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.562314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623af0f9-d553-4eb1-b763-5a879c82e443 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.566992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391ff26-8272-4454-b492-7a4133b25012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.567804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391ff26-8272-4454-b492-7a4133b25012 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.568141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391ff26-8272-4454-b492-7a4133b25012 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.568363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391ff26-8272-4454-b492-7a4133b25012 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.580464 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391ff26-8272-4454-b492-7a4133b25012 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.582294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391ff26-8272-4454-b492-7a4133b25012 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.599020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-f391ff26-8272-4454-b492-7a4133b25012 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:27.600184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 620/1235] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:27.606527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333c3f8-5eca-4d1e-8a40-73e470645672 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.616252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333c3f8-5eca-4d1e-8a40-73e470645672 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.620976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bac232-8eae-41b4-973f-719e08c2615e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.621629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bac232-8eae-41b4-973f-719e08c2615e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.621916 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bac232-8eae-41b4-973f-719e08c2615e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.622718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bac232-8eae-41b4-973f-719e08c2615e admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.623470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bac232-8eae-41b4-973f-719e08c2615e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:27.623802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bac232-8eae-41b4-973f-719e08c2615e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.625769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bac232-8eae-41b4-973f-719e08c2615e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.639603 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 616/1236] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:27.645392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391ff26-8272-4454-b492-7a4133b25012 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.656150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391ff26-8272-4454-b492-7a4133b25012 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.661638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfbbc7-e542-4919-97d0-f6879b52538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.662427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfbbc7-e542-4919-97d0-f6879b52538f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.662712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfbbc7-e542-4919-97d0-f6879b52538f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.662991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfbbc7-e542-4919-97d0-f6879b52538f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.671450 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfbbc7-e542-4919-97d0-f6879b52538f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.673514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfbbc7-e542-4919-97d0-f6879b52538f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.688404 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-7ddfbbc7-e542-4919-97d0-f6879b52538f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 27 16:39:27.689675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 621/1237] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:27.695557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bac232-8eae-41b4-973f-719e08c2615e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.706403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bac232-8eae-41b4-973f-719e08c2615e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.711768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688500d2-9338-4a7f-922e-3937f2063202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.712537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688500d2-9338-4a7f-922e-3937f2063202 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.712887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688500d2-9338-4a7f-922e-3937f2063202 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.713230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688500d2-9338-4a7f-922e-3937f2063202 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.714155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688500d2-9338-4a7f-922e-3937f2063202 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:27.714528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688500d2-9338-4a7f-922e-3937f2063202 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.716523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688500d2-9338-4a7f-922e-3937f2063202 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.735453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 617/1238] 10.222.0.48 () {56 vars in 1164 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:39:27.740590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfbbc7-e542-4919-97d0-f6879b52538f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.751509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfbbc7-e542-4919-97d0-f6879b52538f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.756606 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed6d9e-c413-413d-8969-77ed8574d0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.757328 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed6d9e-c413-413d-8969-77ed8574d0fd admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.757656 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed6d9e-c413-413d-8969-77ed8574d0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.757955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed6d9e-c413-413d-8969-77ed8574d0fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.766945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed6d9e-c413-413d-8969-77ed8574d0fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.768903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed6d9e-c413-413d-8969-77ed8574d0fd admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.779054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 622/1239] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:39:27.785341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688500d2-9338-4a7f-922e-3937f2063202 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.795938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688500d2-9338-4a7f-922e-3937f2063202 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.800920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c506-75c7-453e-a0b1-59d62d1001ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.801707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c506-75c7-453e-a0b1-59d62d1001ec admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.801992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c506-75c7-453e-a0b1-59d62d1001ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.802269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1c506-75c7-453e-a0b1-59d62d1001ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.813480 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1c506-75c7-453e-a0b1-59d62d1001ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.815331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1c506-75c7-453e-a0b1-59d62d1001ec admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.832765 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-e2d1c506-75c7-453e-a0b1-59d62d1001ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:27.833948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 618/1240] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:27.839762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed6d9e-c413-413d-8969-77ed8574d0fd admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.851071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed6d9e-c413-413d-8969-77ed8574d0fd admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.856551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73f1a1-8039-44cc-ab40-064cb3e9f28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.857176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73f1a1-8039-44cc-ab40-064cb3e9f28e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.857568 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73f1a1-8039-44cc-ab40-064cb3e9f28e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.858003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73f1a1-8039-44cc-ab40-064cb3e9f28e admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.858784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73f1a1-8039-44cc-ab40-064cb3e9f28e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:27.859108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73f1a1-8039-44cc-ab40-064cb3e9f28e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.860812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73f1a1-8039-44cc-ab40-064cb3e9f28e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.876265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 623/1241] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:27.882294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c506-75c7-453e-a0b1-59d62d1001ec admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.894286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1c506-75c7-453e-a0b1-59d62d1001ec admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.899240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba689a6-8302-4dee-bc42-7acd095c1f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.900153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba689a6-8302-4dee-bc42-7acd095c1f6e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.900523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba689a6-8302-4dee-bc42-7acd095c1f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.900811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba689a6-8302-4dee-bc42-7acd095c1f6e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.909583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba689a6-8302-4dee-bc42-7acd095c1f6e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.912065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba689a6-8302-4dee-bc42-7acd095c1f6e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.927103 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-8ba689a6-8302-4dee-bc42-7acd095c1f6e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:39:27.928504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 619/1242] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:27.934051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73f1a1-8039-44cc-ab40-064cb3e9f28e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.944091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73f1a1-8039-44cc-ab40-064cb3e9f28e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.949508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a622f7-3266-4078-a496-61739c28994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.950318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a622f7-3266-4078-a496-61739c28994a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.951792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a622f7-3266-4078-a496-61739c28994a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.952255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a622f7-3266-4078-a496-61739c28994a admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.953245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a622f7-3266-4078-a496-61739c28994a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:27.953675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a622f7-3266-4078-a496-61739c28994a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.955594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a622f7-3266-4078-a496-61739c28994a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:27.969237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 624/1243] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:27.975261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba689a6-8302-4dee-bc42-7acd095c1f6e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:27.986888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba689a6-8302-4dee-bc42-7acd095c1f6e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:27.991495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc56666-018c-4359-8f09-6e6e2fd9cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:27.992160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc56666-018c-4359-8f09-6e6e2fd9cc93 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:27.992443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc56666-018c-4359-8f09-6e6e2fd9cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:27.992714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc56666-018c-4359-8f09-6e6e2fd9cc93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:27.993548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc56666-018c-4359-8f09-6e6e2fd9cc93 admin admin] RBAC: Adding query filter params (role.id=a22d2094a5364a8ba169d8e80f4402c5, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=6f5bbcf690d144ab99438b3f65b5e100) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:27.993856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc56666-018c-4359-8f09-6e6e2fd9cc93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:27.995912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc56666-018c-4359-8f09-6e6e2fd9cc93 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:28.004327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 620/1244] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:39:27 2022] GET /identity/v3/role_assignments?user.id=6f5bbcf690d144ab99438b3f65b5e100&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=a22d2094a5364a8ba169d8e80f4402c5 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:39:30.340554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8c0a7-f469-4ce5-a9bd-192c1f99a756 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.341856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8c0a7-f469-4ce5-a9bd-192c1f99a756 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.341856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8c0a7-f469-4ce5-a9bd-192c1f99a756 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.343619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 625/1245] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:30.349039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b719ea7-9dcd-4ba4-8c49-b771852d9f19 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.349456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b719ea7-9dcd-4ba4-8c49-b771852d9f19 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.349574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b719ea7-9dcd-4ba4-8c49-b771852d9f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.368286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1b719ea7-9dcd-4ba4-8c49-b771852d9f19 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:30.369622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1b719ea7-9dcd-4ba4-8c49-b771852d9f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:30.378388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 621/1246] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:39:30.404935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8c0a7-f469-4ce5-a9bd-192c1f99a756 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.420580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8c0a7-f469-4ce5-a9bd-192c1f99a756 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.425437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90798a3b-2163-4305-8182-17058ba502b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.426220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90798a3b-2163-4305-8182-17058ba502b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.426523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90798a3b-2163-4305-8182-17058ba502b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.426816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90798a3b-2163-4305-8182-17058ba502b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.439949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90798a3b-2163-4305-8182-17058ba502b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:39:30.446756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-90798a3b-2163-4305-8182-17058ba502b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:39:30.447967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 626/1247] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:30.455354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b719ea7-9dcd-4ba4-8c49-b771852d9f19 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.464364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b719ea7-9dcd-4ba4-8c49-b771852d9f19 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.469572 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e407f-a188-4b87-aef8-1012acbf7dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.470224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e407f-a188-4b87-aef8-1012acbf7dbd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.470510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e407f-a188-4b87-aef8-1012acbf7dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.470786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e407f-a188-4b87-aef8-1012acbf7dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.471654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e407f-a188-4b87-aef8-1012acbf7dbd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:30.471964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e407f-a188-4b87-aef8-1012acbf7dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.473550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e407f-a188-4b87-aef8-1012acbf7dbd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.481885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 622/1248] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:30.487608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90798a3b-2163-4305-8182-17058ba502b0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.499420 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90798a3b-2163-4305-8182-17058ba502b0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.504117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6944b-0a5a-40a2-825c-457b5ef9fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.504901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6944b-0a5a-40a2-825c-457b5ef9fd19 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.505176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6944b-0a5a-40a2-825c-457b5ef9fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.505453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6944b-0a5a-40a2-825c-457b5ef9fd19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.517021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6944b-0a5a-40a2-825c-457b5ef9fd19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.518924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6944b-0a5a-40a2-825c-457b5ef9fd19 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.536854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-d4f6944b-0a5a-40a2-825c-457b5ef9fd19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:30.538186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 627/1249] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:39:30.545089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e407f-a188-4b87-aef8-1012acbf7dbd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.555331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e407f-a188-4b87-aef8-1012acbf7dbd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.561168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6e365-4c7a-47f4-bbb7-69168e9af207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.561885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6e365-4c7a-47f4-bbb7-69168e9af207 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.562198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6e365-4c7a-47f4-bbb7-69168e9af207 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.562490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6e365-4c7a-47f4-bbb7-69168e9af207 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.563300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6e365-4c7a-47f4-bbb7-69168e9af207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:30.563667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6e365-4c7a-47f4-bbb7-69168e9af207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.565382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6e365-4c7a-47f4-bbb7-69168e9af207 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.577963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 623/1250] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:39:30.584124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6944b-0a5a-40a2-825c-457b5ef9fd19 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.595015 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6944b-0a5a-40a2-825c-457b5ef9fd19 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.600064 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33af727-7d38-48b0-bb13-04e868cebe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.601021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33af727-7d38-48b0-bb13-04e868cebe06 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.601367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33af727-7d38-48b0-bb13-04e868cebe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.601656 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33af727-7d38-48b0-bb13-04e868cebe06 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.610750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33af727-7d38-48b0-bb13-04e868cebe06 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.612782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33af727-7d38-48b0-bb13-04e868cebe06 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.629290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-d33af727-7d38-48b0-bb13-04e868cebe06 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 27 16:39:30.630720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 628/1251] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:39:30.637023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6e365-4c7a-47f4-bbb7-69168e9af207 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.648166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6e365-4c7a-47f4-bbb7-69168e9af207 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.653208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a5d4c-beb8-4824-985e-223483981724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.654081 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a5d4c-beb8-4824-985e-223483981724 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.654363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a5d4c-beb8-4824-985e-223483981724 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.654643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a5d4c-beb8-4824-985e-223483981724 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.655517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a5d4c-beb8-4824-985e-223483981724 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:30.655877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a5d4c-beb8-4824-985e-223483981724 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.658090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a5d4c-beb8-4824-985e-223483981724 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.677271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 624/1252] 10.222.0.48 () {56 vars in 1164 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:30.683359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33af727-7d38-48b0-bb13-04e868cebe06 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.695542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33af727-7d38-48b0-bb13-04e868cebe06 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.701003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df5bd6-4de2-44cc-afe1-aa9fa7e187c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.702192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df5bd6-4de2-44cc-afe1-aa9fa7e187c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.702629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df5bd6-4de2-44cc-afe1-aa9fa7e187c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.703055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df5bd6-4de2-44cc-afe1-aa9fa7e187c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.711774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df5bd6-4de2-44cc-afe1-aa9fa7e187c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.713520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df5bd6-4de2-44cc-afe1-aa9fa7e187c7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.722727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 629/1253] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:39:30.728611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a5d4c-beb8-4824-985e-223483981724 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.739771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a5d4c-beb8-4824-985e-223483981724 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.744629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed490b90-6bbb-432f-9b38-5e6fa05b0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.745507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed490b90-6bbb-432f-9b38-5e6fa05b0496 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.745818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed490b90-6bbb-432f-9b38-5e6fa05b0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.746149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed490b90-6bbb-432f-9b38-5e6fa05b0496 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.759258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed490b90-6bbb-432f-9b38-5e6fa05b0496 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.761132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed490b90-6bbb-432f-9b38-5e6fa05b0496 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.778868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-ed490b90-6bbb-432f-9b38-5e6fa05b0496 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:30.780345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 625/1254] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:30.785996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df5bd6-4de2-44cc-afe1-aa9fa7e187c7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.796115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df5bd6-4de2-44cc-afe1-aa9fa7e187c7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.800647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c8e37-08dc-465a-ba72-5dded61fd285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.801294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c8e37-08dc-465a-ba72-5dded61fd285 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.801577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c8e37-08dc-465a-ba72-5dded61fd285 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.801871 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c8e37-08dc-465a-ba72-5dded61fd285 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.802609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c8e37-08dc-465a-ba72-5dded61fd285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:30.802915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c8e37-08dc-465a-ba72-5dded61fd285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.804528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c8e37-08dc-465a-ba72-5dded61fd285 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.816820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 630/1255] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:30.822430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed490b90-6bbb-432f-9b38-5e6fa05b0496 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.832411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed490b90-6bbb-432f-9b38-5e6fa05b0496 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.837240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbda3-50e6-4d22-99e5-282870daac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.838015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbda3-50e6-4d22-99e5-282870daac89 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.838304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbda3-50e6-4d22-99e5-282870daac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.838597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decdbda3-50e6-4d22-99e5-282870daac89 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.846761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdbda3-50e6-4d22-99e5-282870daac89 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.848698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decdbda3-50e6-4d22-99e5-282870daac89 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.865520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-decdbda3-50e6-4d22-99e5-282870daac89 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:39:30.867176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 626/1256] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:30.873375 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c8e37-08dc-465a-ba72-5dded61fd285 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.885093 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c8e37-08dc-465a-ba72-5dded61fd285 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.891899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3bb12-690b-451c-ad0c-fb4e26721e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.892562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3bb12-690b-451c-ad0c-fb4e26721e6f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.892903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3bb12-690b-451c-ad0c-fb4e26721e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.893129 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3bb12-690b-451c-ad0c-fb4e26721e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.893939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3bb12-690b-451c-ad0c-fb4e26721e6f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:30.894321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3bb12-690b-451c-ad0c-fb4e26721e6f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.896312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3bb12-690b-451c-ad0c-fb4e26721e6f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.916462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 631/1257] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:30.917875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbda3-50e6-4d22-99e5-282870daac89 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:30.931320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decdbda3-50e6-4d22-99e5-282870daac89 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:30.937271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf3f8d-b59a-47f7-93e2-9ccdc7c13ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:30.937954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3f8d-b59a-47f7-93e2-9ccdc7c13ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:30.938241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3f8d-b59a-47f7-93e2-9ccdc7c13ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:30.938518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf3f8d-b59a-47f7-93e2-9ccdc7c13ae0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:30.939363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3f8d-b59a-47f7-93e2-9ccdc7c13ae0 admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=6f5bbcf690d144ab99438b3f65b5e100) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:30.939733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3f8d-b59a-47f7-93e2-9ccdc7c13ae0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:30.941639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf3f8d-b59a-47f7-93e2-9ccdc7c13ae0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:30.947551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 627/1258] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:39:30 2022] GET /identity/v3/role_assignments?user.id=6f5bbcf690d144ab99438b3f65b5e100&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:33.339552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779702-c19a-47b7-b867-e168e75c091f None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.340132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779702-c19a-47b7-b867-e168e75c091f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.340132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46779702-c19a-47b7-b867-e168e75c091f None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.342727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 632/1259] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:33.348575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a506-8329-4a14-bf6a-360cbf99ed16 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.348999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a506-8329-4a14-bf6a-360cbf99ed16 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.349204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590a506-8329-4a14-bf6a-360cbf99ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.368171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-f590a506-8329-4a14-bf6a-360cbf99ed16 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:33.369584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f590a506-8329-4a14-bf6a-360cbf99ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:33.379227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 628/1260] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:39:33.406193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779702-c19a-47b7-b867-e168e75c091f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.418682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46779702-c19a-47b7-b867-e168e75c091f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.423919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa47c54-8911-43c7-8ea8-8db9e336a427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.424707 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa47c54-8911-43c7-8ea8-8db9e336a427 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.425033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa47c54-8911-43c7-8ea8-8db9e336a427 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.425390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa47c54-8911-43c7-8ea8-8db9e336a427 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.438333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa47c54-8911-43c7-8ea8-8db9e336a427 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:39:33.445453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-2aa47c54-8911-43c7-8ea8-8db9e336a427 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:39:33.447206 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 633/1261] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:33.455075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590a506-8329-4a14-bf6a-360cbf99ed16 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.464342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590a506-8329-4a14-bf6a-360cbf99ed16 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.469148 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f76d19-a803-4ef4-bbc7-bd3ae26765f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.469813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f76d19-a803-4ef4-bbc7-bd3ae26765f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.470096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f76d19-a803-4ef4-bbc7-bd3ae26765f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.470371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f76d19-a803-4ef4-bbc7-bd3ae26765f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.471184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f76d19-a803-4ef4-bbc7-bd3ae26765f5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:33.471496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f76d19-a803-4ef4-bbc7-bd3ae26765f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.473200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f76d19-a803-4ef4-bbc7-bd3ae26765f5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.481964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 629/1262] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:33.489046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa47c54-8911-43c7-8ea8-8db9e336a427 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.500466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa47c54-8911-43c7-8ea8-8db9e336a427 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.506298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcd441-18dd-4764-aac6-107d54cc028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.507146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcd441-18dd-4764-aac6-107d54cc028a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.507519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcd441-18dd-4764-aac6-107d54cc028a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.507900 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcd441-18dd-4764-aac6-107d54cc028a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.520231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcd441-18dd-4764-aac6-107d54cc028a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.522074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcd441-18dd-4764-aac6-107d54cc028a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.539245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-4ffcd441-18dd-4764-aac6-107d54cc028a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:33.540452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 634/1263] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:33.547740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f76d19-a803-4ef4-bbc7-bd3ae26765f5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.558242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f76d19-a803-4ef4-bbc7-bd3ae26765f5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.563510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45b3b-481f-48b4-b829-9f5d33721626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.564405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45b3b-481f-48b4-b829-9f5d33721626 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.564700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45b3b-481f-48b4-b829-9f5d33721626 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.565159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45b3b-481f-48b4-b829-9f5d33721626 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.565934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df45b3b-481f-48b4-b829-9f5d33721626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:33.566252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df45b3b-481f-48b4-b829-9f5d33721626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.568040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df45b3b-481f-48b4-b829-9f5d33721626 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.583209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 630/1264] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:33.589746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcd441-18dd-4764-aac6-107d54cc028a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.600444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcd441-18dd-4764-aac6-107d54cc028a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.605418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f10a4-4f15-465d-a476-41f60279839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.606300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f10a4-4f15-465d-a476-41f60279839d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.606644 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f10a4-4f15-465d-a476-41f60279839d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.607077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f10a4-4f15-465d-a476-41f60279839d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.615222 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f10a4-4f15-465d-a476-41f60279839d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.617411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f10a4-4f15-465d-a476-41f60279839d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.632803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-767f10a4-4f15-465d-a476-41f60279839d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 27 16:39:33.633990 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 635/1265] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:33.640285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45b3b-481f-48b4-b829-9f5d33721626 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.650465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45b3b-481f-48b4-b829-9f5d33721626 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.655929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee50a-e076-4904-b980-4ddb7a5645a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.656615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee50a-e076-4904-b980-4ddb7a5645a1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.656910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee50a-e076-4904-b980-4ddb7a5645a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.657187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ee50a-e076-4904-b980-4ddb7a5645a1 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.658041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ee50a-e076-4904-b980-4ddb7a5645a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:33.658353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ee50a-e076-4904-b980-4ddb7a5645a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.660338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ee50a-e076-4904-b980-4ddb7a5645a1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.679792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 631/1266] 10.222.0.48 () {56 vars in 1164 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:33.686387 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f10a4-4f15-465d-a476-41f60279839d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.696907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f10a4-4f15-465d-a476-41f60279839d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.703435 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc1201-0831-450e-a7a1-963af79dc904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.704390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc1201-0831-450e-a7a1-963af79dc904 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.704725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc1201-0831-450e-a7a1-963af79dc904 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.704998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc1201-0831-450e-a7a1-963af79dc904 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.716716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc1201-0831-450e-a7a1-963af79dc904 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.718554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc1201-0831-450e-a7a1-963af79dc904 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.736907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-05cc1201-0831-450e-a7a1-963af79dc904 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:33.738110 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 636/1267] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jan 27 16:39:33.744373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee50a-e076-4904-b980-4ddb7a5645a1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.755216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ee50a-e076-4904-b980-4ddb7a5645a1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.761216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47935f4b-f086-40ab-9059-9a4456e2bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.762271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47935f4b-f086-40ab-9059-9a4456e2bc17 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.762629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47935f4b-f086-40ab-9059-9a4456e2bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.764360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47935f4b-f086-40ab-9059-9a4456e2bc17 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.765071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47935f4b-f086-40ab-9059-9a4456e2bc17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:33.765479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47935f4b-f086-40ab-9059-9a4456e2bc17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.767848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47935f4b-f086-40ab-9059-9a4456e2bc17 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.783546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 632/1268] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:33.789705 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc1201-0831-450e-a7a1-963af79dc904 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.806229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc1201-0831-450e-a7a1-963af79dc904 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.812130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29ef44-0db1-493d-a068-970520a7c92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.812948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29ef44-0db1-493d-a068-970520a7c92e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.813230 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29ef44-0db1-493d-a068-970520a7c92e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.813505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29ef44-0db1-493d-a068-970520a7c92e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.821231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29ef44-0db1-493d-a068-970520a7c92e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.823268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29ef44-0db1-493d-a068-970520a7c92e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.837753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-5e29ef44-0db1-493d-a068-970520a7c92e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:39:33.839024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 637/1269] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:33.845721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47935f4b-f086-40ab-9059-9a4456e2bc17 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.856402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47935f4b-f086-40ab-9059-9a4456e2bc17 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.862810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d6a86-6fcc-4e4b-b6ce-f49b4efb8ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.863552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d6a86-6fcc-4e4b-b6ce-f49b4efb8ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.863864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d6a86-6fcc-4e4b-b6ce-f49b4efb8ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.864265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d6a86-6fcc-4e4b-b6ce-f49b4efb8ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.865060 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d6a86-6fcc-4e4b-b6ce-f49b4efb8ce9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:33.865381 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d6a86-6fcc-4e4b-b6ce-f49b4efb8ce9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.867307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d6a86-6fcc-4e4b-b6ce-f49b4efb8ce9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.882662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 633/1270] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:33.889180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29ef44-0db1-493d-a068-970520a7c92e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:33.901657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29ef44-0db1-493d-a068-970520a7c92e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:33.907160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19ecdf-b659-4b3c-a318-86b53724fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:33.908148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19ecdf-b659-4b3c-a318-86b53724fc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:33.908470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19ecdf-b659-4b3c-a318-86b53724fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:33.908747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19ecdf-b659-4b3c-a318-86b53724fc3c admin admin] PATH_INFO: `/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/6f5bbcf690d144ab99438b3f65b5e100/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:33.910915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19ecdf-b659-4b3c-a318-86b53724fc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a0cf607357487a8b6b217245c7eeb9, user_id=6f5bbcf690d144ab99438b3f65b5e100, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:33.914081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19ecdf-b659-4b3c-a318-86b53724fc3c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:33.929406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 638/1271] 10.222.0.48 () {58 vars in 1460 bytes} [Thu Jan 27 16:39:33 2022] PUT /identity/v3/projects/84a0cf607357487a8b6b217245c7eeb9/users/6f5bbcf690d144ab99438b3f65b5e100/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:39:36.184337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b1f4-2e19-4aa3-9d45-18f105d15263 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.185689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b1f4-2e19-4aa3-9d45-18f105d15263 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.185689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b1f4-2e19-4aa3-9d45-18f105d15263 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.187370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 634/1272] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:36.192670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe1e9-7b42-43d3-a242-cc83bda7c5e8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.193042 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe1e9-7b42-43d3-a242-cc83bda7c5e8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.193234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe1e9-7b42-43d3-a242-cc83bda7c5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.210448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-614fe1e9-7b42-43d3-a242-cc83bda7c5e8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:36.211669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-614fe1e9-7b42-43d3-a242-cc83bda7c5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:36.266492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 639/1273] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:39:36.290790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b1f4-2e19-4aa3-9d45-18f105d15263 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.303225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b1f4-2e19-4aa3-9d45-18f105d15263 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.307556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d1baa-dc6d-4cde-9ca8-bb5338914221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.308347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d1baa-dc6d-4cde-9ca8-bb5338914221 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.308633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d1baa-dc6d-4cde-9ca8-bb5338914221 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.308911 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d1baa-dc6d-4cde-9ca8-bb5338914221 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.319320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d1baa-dc6d-4cde-9ca8-bb5338914221 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jan 27 16:39:36.326174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-5c1d1baa-dc6d-4cde-9ca8-bb5338914221 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jan 27 16:39:36.327446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 635/1274] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:36.332885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe1e9-7b42-43d3-a242-cc83bda7c5e8 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.341575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe1e9-7b42-43d3-a242-cc83bda7c5e8 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.346080 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf14ff-d443-4ec2-bec3-3d9387dca4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.346732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf14ff-d443-4ec2-bec3-3d9387dca4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.347017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf14ff-d443-4ec2-bec3-3d9387dca4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.347298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf14ff-d443-4ec2-bec3-3d9387dca4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.348100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf14ff-d443-4ec2-bec3-3d9387dca4d2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:36.348411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf14ff-d443-4ec2-bec3-3d9387dca4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.349994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf14ff-d443-4ec2-bec3-3d9387dca4d2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.358976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 640/1275] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:36.364288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d1baa-dc6d-4cde-9ca8-bb5338914221 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.374956 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d1baa-dc6d-4cde-9ca8-bb5338914221 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.379364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48177f-191f-4bb4-9b08-d4db8f39644d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.380152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48177f-191f-4bb4-9b08-d4db8f39644d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.380438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48177f-191f-4bb4-9b08-d4db8f39644d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.380717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48177f-191f-4bb4-9b08-d4db8f39644d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.390617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48177f-191f-4bb4-9b08-d4db8f39644d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.392467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48177f-191f-4bb4-9b08-d4db8f39644d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.408754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-ff48177f-191f-4bb4-9b08-d4db8f39644d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:36.409871 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 636/1276] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:36.415511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf14ff-d443-4ec2-bec3-3d9387dca4d2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.425615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf14ff-d443-4ec2-bec3-3d9387dca4d2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.430085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a7e70-1a16-446d-a8e8-b1e7138697bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.430726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7e70-1a16-446d-a8e8-b1e7138697bf admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.431010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7e70-1a16-446d-a8e8-b1e7138697bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.431287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7e70-1a16-446d-a8e8-b1e7138697bf admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.432148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a7e70-1a16-446d-a8e8-b1e7138697bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:36.432462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a7e70-1a16-446d-a8e8-b1e7138697bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.434035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a7e70-1a16-446d-a8e8-b1e7138697bf admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.445980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 641/1277] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:36.451110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48177f-191f-4bb4-9b08-d4db8f39644d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.460535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48177f-191f-4bb4-9b08-d4db8f39644d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.464948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83281c54-5af7-474e-bed0-02d0c2265362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.466199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83281c54-5af7-474e-bed0-02d0c2265362 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.466485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83281c54-5af7-474e-bed0-02d0c2265362 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.466753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83281c54-5af7-474e-bed0-02d0c2265362 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.473762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83281c54-5af7-474e-bed0-02d0c2265362 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.475775 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83281c54-5af7-474e-bed0-02d0c2265362 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.489968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-83281c54-5af7-474e-bed0-02d0c2265362 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jan 27 16:39:36.491065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 637/1278] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:36.496599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a7e70-1a16-446d-a8e8-b1e7138697bf admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.506287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a7e70-1a16-446d-a8e8-b1e7138697bf admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.510697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09828d75-cf53-4f86-a42e-49914da9aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.511344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09828d75-cf53-4f86-a42e-49914da9aa4c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.511651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09828d75-cf53-4f86-a42e-49914da9aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.511930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09828d75-cf53-4f86-a42e-49914da9aa4c admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.512858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09828d75-cf53-4f86-a42e-49914da9aa4c admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:36.513172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09828d75-cf53-4f86-a42e-49914da9aa4c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.514993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09828d75-cf53-4f86-a42e-49914da9aa4c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.531954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 642/1279] 10.222.0.48 () {56 vars in 1164 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:36.537600 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83281c54-5af7-474e-bed0-02d0c2265362 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.547826 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83281c54-5af7-474e-bed0-02d0c2265362 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.552228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cfc93-29ad-42fd-b081-ba96363f3fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.552853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cfc93-29ad-42fd-b081-ba96363f3fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.553133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cfc93-29ad-42fd-b081-ba96363f3fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.553407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cfc93-29ad-42fd-b081-ba96363f3fb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.561100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cfc93-29ad-42fd-b081-ba96363f3fb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.562820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cfc93-29ad-42fd-b081-ba96363f3fb5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.571254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 638/1280] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:39:36.576941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09828d75-cf53-4f86-a42e-49914da9aa4c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.586364 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09828d75-cf53-4f86-a42e-49914da9aa4c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.591437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb63ea1-733b-4645-89ba-a1e082efce96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.592410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb63ea1-733b-4645-89ba-a1e082efce96 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.592695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb63ea1-733b-4645-89ba-a1e082efce96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.592973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb63ea1-733b-4645-89ba-a1e082efce96 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.602914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb63ea1-733b-4645-89ba-a1e082efce96 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.604755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb63ea1-733b-4645-89ba-a1e082efce96 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.621335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-cfb63ea1-733b-4645-89ba-a1e082efce96 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jan 27 16:39:36.622727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 643/1281] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:36.628118 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cfc93-29ad-42fd-b081-ba96363f3fb5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.636732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cfc93-29ad-42fd-b081-ba96363f3fb5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.641614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c93a8-6774-4faf-b6be-21f7f4295ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.642254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c93a8-6774-4faf-b6be-21f7f4295ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.642535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c93a8-6774-4faf-b6be-21f7f4295ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.642810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c93a8-6774-4faf-b6be-21f7f4295ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.643525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c93a8-6774-4faf-b6be-21f7f4295ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:36.643859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c93a8-6774-4faf-b6be-21f7f4295ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.645424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c93a8-6774-4faf-b6be-21f7f4295ca9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.657680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 639/1282] 10.222.0.48 () {56 vars in 1130 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:36.663235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb63ea1-733b-4645-89ba-a1e082efce96 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.673267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb63ea1-733b-4645-89ba-a1e082efce96 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.677622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9f303-0ba8-4056-8847-6554263995a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.678376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9f303-0ba8-4056-8847-6554263995a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.678658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9f303-0ba8-4056-8847-6554263995a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.678932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9f303-0ba8-4056-8847-6554263995a8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.685621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9f303-0ba8-4056-8847-6554263995a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.687526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9f303-0ba8-4056-8847-6554263995a8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.700026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING keystone.server.flask.application [None req-5fa9f303-0ba8-4056-8847-6554263995a8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jan 27 16:39:36.701089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 644/1283] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:36.706499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c93a8-6774-4faf-b6be-21f7f4295ca9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.716602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c93a8-6774-4faf-b6be-21f7f4295ca9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.721262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b33b63-83d2-4e83-bb69-53d4c8f0a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.721899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b33b63-83d2-4e83-bb69-53d4c8f0a6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.722183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b33b63-83d2-4e83-bb69-53d4c8f0a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.722464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b33b63-83d2-4e83-bb69-53d4c8f0a6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.723288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b33b63-83d2-4e83-bb69-53d4c8f0a6f5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:36.723625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b33b63-83d2-4e83-bb69-53d4c8f0a6f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.725455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b33b63-83d2-4e83-bb69-53d4c8f0a6f5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.737735 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 640/1284] 10.222.0.48 () {56 vars in 1169 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:36.743276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9f303-0ba8-4056-8847-6554263995a8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:36.753105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9f303-0ba8-4056-8847-6554263995a8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:36.757448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645554b6-e00e-404a-860b-3fd1c7be15ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:36.758055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645554b6-e00e-404a-860b-3fd1c7be15ca admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:36.758336 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645554b6-e00e-404a-860b-3fd1c7be15ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:36.758614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645554b6-e00e-404a-860b-3fd1c7be15ca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:36.759427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645554b6-e00e-404a-860b-3fd1c7be15ca admin admin] RBAC: Adding query filter params (role.id=b635b195d45a4fdeaa8c60f1e5b04127, scope.project.id=84a0cf607357487a8b6b217245c7eeb9, user.id=6f5bbcf690d144ab99438b3f65b5e100) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:36.759765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645554b6-e00e-404a-860b-3fd1c7be15ca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:36.761549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645554b6-e00e-404a-860b-3fd1c7be15ca admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:36.767173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 645/1285] 10.222.0.48 () {56 vars in 1395 bytes} [Thu Jan 27 16:39:36 2022] GET /identity/v3/role_assignments?user.id=6f5bbcf690d144ab99438b3f65b5e100&scope.project.id=84a0cf607357487a8b6b217245c7eeb9&role.id=b635b195d45a4fdeaa8c60f1e5b04127 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:39:39.078924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34ea3-4571-40be-8cb9-4193a58ed48f None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:39.079541 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34ea3-4571-40be-8cb9-4193a58ed48f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:39.079541 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da34ea3-4571-40be-8cb9-4193a58ed48f None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:39.081294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 641/1286] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:39.086350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c48d29-ca7e-4f44-bb23-e21ebaf33446 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:39.086785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c48d29-ca7e-4f44-bb23-e21ebaf33446 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:39.086891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c48d29-ca7e-4f44-bb23-e21ebaf33446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:39.104753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d1c48d29-ca7e-4f44-bb23-e21ebaf33446 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:39.105927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d1c48d29-ca7e-4f44-bb23-e21ebaf33446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:39.113400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 646/1287] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:39:39.135885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da34ea3-4571-40be-8cb9-4193a58ed48f None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:39.148354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da34ea3-4571-40be-8cb9-4193a58ed48f None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:39.152699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514569d-b612-4541-98a8-fe83928ba893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:39.154115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514569d-b612-4541-98a8-fe83928ba893 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:39.154398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514569d-b612-4541-98a8-fe83928ba893 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:39.154680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514569d-b612-4541-98a8-fe83928ba893 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:39.155340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514569d-b612-4541-98a8-fe83928ba893 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:39.156972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514569d-b612-4541-98a8-fe83928ba893 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:39.167968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-5514569d-b612-4541-98a8-fe83928ba893 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 27 16:39:39.169549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 642/1288] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:39:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:39.175049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c48d29-ca7e-4f44-bb23-e21ebaf33446 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:39.183791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c48d29-ca7e-4f44-bb23-e21ebaf33446 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:39.188439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58890aeb-77e7-4b5e-962a-93902c120d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:39.189080 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58890aeb-77e7-4b5e-962a-93902c120d3a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:39.189360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58890aeb-77e7-4b5e-962a-93902c120d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:39.189631 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58890aeb-77e7-4b5e-962a-93902c120d3a admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:39.190344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58890aeb-77e7-4b5e-962a-93902c120d3a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:39.190651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58890aeb-77e7-4b5e-962a-93902c120d3a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:39.192252 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58890aeb-77e7-4b5e-962a-93902c120d3a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:39.196857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 647/1289] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jan 27 16:39:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:39.202540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514569d-b612-4541-98a8-fe83928ba893 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:39.211773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514569d-b612-4541-98a8-fe83928ba893 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:39.216932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c414dd5-7ff0-4131-9a34-af832115148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:39.217559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c414dd5-7ff0-4131-9a34-af832115148a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:39.217841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c414dd5-7ff0-4131-9a34-af832115148a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:39.218116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c414dd5-7ff0-4131-9a34-af832115148a admin admin] PATH_INFO: `/v3/services` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:39.218818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c414dd5-7ff0-4131-9a34-af832115148a admin admin] RBAC: Adding query filter params (type=placement) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:39.219121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c414dd5-7ff0-4131-9a34-af832115148a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:39.220703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c414dd5-7ff0-4131-9a34-af832115148a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:39.224890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 643/1290] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jan 27 16:39:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:41.407894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730043-7d6f-434c-836a-28b334f942aa None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:41.408459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730043-7d6f-434c-836a-28b334f942aa None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:41.408459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe730043-7d6f-434c-836a-28b334f942aa None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:41.410308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 648/1291] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:41.415847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef85f2-2c8c-4c48-bba0-e39df5cf8cef None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:41.416233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef85f2-2c8c-4c48-bba0-e39df5cf8cef None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:41.416402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef85f2-2c8c-4c48-bba0-e39df5cf8cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:41.433644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ffef85f2-2c8c-4c48-bba0-e39df5cf8cef None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:41.434827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ffef85f2-2c8c-4c48-bba0-e39df5cf8cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:41.442425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 644/1292] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:39:41.465443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730043-7d6f-434c-836a-28b334f942aa None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:41.477904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe730043-7d6f-434c-836a-28b334f942aa None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:41.482216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d68b83-e27a-4d05-8bbb-76ac104efbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:41.482853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d68b83-e27a-4d05-8bbb-76ac104efbab admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:41.483136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d68b83-e27a-4d05-8bbb-76ac104efbab admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:41.483415 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d68b83-e27a-4d05-8bbb-76ac104efbab admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:41.484185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d68b83-e27a-4d05-8bbb-76ac104efbab admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:41.485773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d68b83-e27a-4d05-8bbb-76ac104efbab admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:41.498476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 649/1293] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Jan 27 16:39:41 2022] POST /identity/v3/services => generated 246 bytes in 33 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:39:43.723239 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c26b-432a-41d1-b28a-e4aaa583fb43 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:43.723822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c26b-432a-41d1-b28a-e4aaa583fb43 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:43.723822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17c26b-432a-41d1-b28a-e4aaa583fb43 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:43.725575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 645/1294] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:43.730807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731a54-2435-4122-99f8-5926708f7117 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:43.731829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731a54-2435-4122-99f8-5926708f7117 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:43.731975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731a54-2435-4122-99f8-5926708f7117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:43.749648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-f9731a54-2435-4122-99f8-5926708f7117 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:43.750827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f9731a54-2435-4122-99f8-5926708f7117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:43.767630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 650/1295] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:43 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:39:43.791261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17c26b-432a-41d1-b28a-e4aaa583fb43 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:43.803323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17c26b-432a-41d1-b28a-e4aaa583fb43 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:43.807510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17a8cc-c5fe-4312-9976-3e3c7019936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:43.808316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a8cc-c5fe-4312-9976-3e3c7019936f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:43.808595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a8cc-c5fe-4312-9976-3e3c7019936f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:43.808868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a8cc-c5fe-4312-9976-3e3c7019936f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:43.809529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17a8cc-c5fe-4312-9976-3e3c7019936f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:43.811230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17a8cc-c5fe-4312-9976-3e3c7019936f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:43.821817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-dc17a8cc-c5fe-4312-9976-3e3c7019936f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 27 16:39:43.822919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 646/1296] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:39:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:43.829270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9731a54-2435-4122-99f8-5926708f7117 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:43.837961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9731a54-2435-4122-99f8-5926708f7117 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:43.843113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f959d4-c263-4f4d-b6d3-2bdf750cd366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:43.843932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f959d4-c263-4f4d-b6d3-2bdf750cd366 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:43.844244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f959d4-c263-4f4d-b6d3-2bdf750cd366 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:43.844637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f959d4-c263-4f4d-b6d3-2bdf750cd366 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:43.845559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f959d4-c263-4f4d-b6d3-2bdf750cd366 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:43.845908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f959d4-c263-4f4d-b6d3-2bdf750cd366 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:43.847810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f959d4-c263-4f4d-b6d3-2bdf750cd366 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:43.853486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 651/1297] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jan 27 16:39:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:43.860694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17a8cc-c5fe-4312-9976-3e3c7019936f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:43.870323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17a8cc-c5fe-4312-9976-3e3c7019936f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:43.875786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc8ad3f-870a-458e-83b2-78e6027bf453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:43.876423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ad3f-870a-458e-83b2-78e6027bf453 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:43.876709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ad3f-870a-458e-83b2-78e6027bf453 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:43.877050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc8ad3f-870a-458e-83b2-78e6027bf453 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:43.877827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ad3f-870a-458e-83b2-78e6027bf453 admin admin] RBAC: Adding query filter params (interface=public, service_id=87f913ab48b5412587df2aff4623c7e6, region_id=RegionOne) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:43.878136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ad3f-870a-458e-83b2-78e6027bf453 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:43.879870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc8ad3f-870a-458e-83b2-78e6027bf453 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:43.885006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 647/1298] 10.222.0.48 () {56 vars in 1272 bytes} [Thu Jan 27 16:39:43 2022] GET /identity/v3/endpoints?service_id=87f913ab48b5412587df2aff4623c7e6&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:43.891494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f959d4-c263-4f4d-b6d3-2bdf750cd366 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:43.902168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f959d4-c263-4f4d-b6d3-2bdf750cd366 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:43.907731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c38799-ee28-4cd7-927a-8c36f33231c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:43.908481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c38799-ee28-4cd7-927a-8c36f33231c9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:43.908789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c38799-ee28-4cd7-927a-8c36f33231c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:43.909087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c38799-ee28-4cd7-927a-8c36f33231c9 admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:43.909867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c38799-ee28-4cd7-927a-8c36f33231c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:43.912169 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c38799-ee28-4cd7-927a-8c36f33231c9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:43.921016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 652/1299] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:39:43 2022] GET /identity/v3/services => generated 2191 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:39:46.134229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6c132-bd41-4d90-b64d-eb644c33f9cc None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:46.134766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6c132-bd41-4d90-b64d-eb644c33f9cc None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:46.134766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6c132-bd41-4d90-b64d-eb644c33f9cc None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:46.136594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 648/1300] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:39:46.142367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eae72-56ff-4cca-9e06-0297e32d71e9 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:46.142779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eae72-56ff-4cca-9e06-0297e32d71e9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:46.142919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eae72-56ff-4cca-9e06-0297e32d71e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:46.160625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-909eae72-56ff-4cca-9e06-0297e32d71e9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:39:46.162040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-909eae72-56ff-4cca-9e06-0297e32d71e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:39:46.169719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 653/1301] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:39:46 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:39:46.192609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6c132-bd41-4d90-b64d-eb644c33f9cc None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:46.205134 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6c132-bd41-4d90-b64d-eb644c33f9cc None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:46.209598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564bd5d-9f65-4c30-b8e0-426cdbd59fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:46.210374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564bd5d-9f65-4c30-b8e0-426cdbd59fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:46.210653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564bd5d-9f65-4c30-b8e0-426cdbd59fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:46.210928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564bd5d-9f65-4c30-b8e0-426cdbd59fb1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:46.211615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564bd5d-9f65-4c30-b8e0-426cdbd59fb1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:46.213187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564bd5d-9f65-4c30-b8e0-426cdbd59fb1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:46.223931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING keystone.server.flask.application [None req-f564bd5d-9f65-4c30-b8e0-426cdbd59fb1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jan 27 16:39:46.225032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 649/1302] 10.222.0.48 () {56 vars in 1138 bytes} [Thu Jan 27 16:39:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jan 27 16:39:46.230720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909eae72-56ff-4cca-9e06-0297e32d71e9 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:46.239299 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909eae72-56ff-4cca-9e06-0297e32d71e9 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:46.243701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e88998a-34f9-4771-a9c7-6e9b495a486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:46.244333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88998a-34f9-4771-a9c7-6e9b495a486b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:46.244617 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88998a-34f9-4771-a9c7-6e9b495a486b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:46.244892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88998a-34f9-4771-a9c7-6e9b495a486b admin admin] PATH_INFO: `/v3/services` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:46.245598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88998a-34f9-4771-a9c7-6e9b495a486b admin admin] RBAC: Adding query filter params (name=placement) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:39:46.245900 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88998a-34f9-4771-a9c7-6e9b495a486b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:46.248066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e88998a-34f9-4771-a9c7-6e9b495a486b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:46.252965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 654/1303] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jan 27 16:39:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:39:46.258269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564bd5d-9f65-4c30-b8e0-426cdbd59fb1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:39:46.268720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564bd5d-9f65-4c30-b8e0-426cdbd59fb1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:39:46.273142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbf522-2301-45a4-9b18-10f2b311aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:39:46.273761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf522-2301-45a4-9b18-10f2b311aace admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:39:46.274053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf522-2301-45a4-9b18-10f2b311aace admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:39:46.274329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbf522-2301-45a4-9b18-10f2b311aace admin admin] PATH_INFO: `/v3/endpoints` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:39:46.275072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbf522-2301-45a4-9b18-10f2b311aace admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:39:46.276670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbf522-2301-45a4-9b18-10f2b311aace admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:39:46.294564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 650/1304] 10.222.0.48 () {60 vars in 1165 bytes} [Thu Jan 27 16:39:46 2022] POST /identity/v3/endpoints => generated 331 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:40:49.158366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f92da3-4ff2-4ed3-885e-bd20f7bb97a8 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:49.158854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f92da3-4ff2-4ed3-885e-bd20f7bb97a8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:49.158933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f92da3-4ff2-4ed3-885e-bd20f7bb97a8 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:49.161467 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 655/1305] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:40:49.166677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81070ad-c192-4324-b5f7-b7a438efffad None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:49.167202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81070ad-c192-4324-b5f7-b7a438efffad None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:49.167202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81070ad-c192-4324-b5f7-b7a438efffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:49.279891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e81070ad-c192-4324-b5f7-b7a438efffad None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:40:49.281121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e81070ad-c192-4324-b5f7-b7a438efffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:49.397234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 651/1306] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:40:49.424580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f92da3-4ff2-4ed3-885e-bd20f7bb97a8 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:40:49.426329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-31f92da3-4ff2-4ed3-885e-bd20f7bb97a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:49.574471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f92da3-4ff2-4ed3-885e-bd20f7bb97a8 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:40:49.669432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1500dd-5451-4d92-a7ae-5d8e54713b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:40:49.670391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1500dd-5451-4d92-a7ae-5d8e54713b16 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:49.670858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1500dd-5451-4d92-a7ae-5d8e54713b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:49.671311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1500dd-5451-4d92-a7ae-5d8e54713b16 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:49.672285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1500dd-5451-4d92-a7ae-5d8e54713b16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:40:49.674335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1500dd-5451-4d92-a7ae-5d8e54713b16 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:40:49.694111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 656/1307] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:40:49 2022] GET /identity/v3/projects => generated 2553 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:40:52.017001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab108-f2b4-421b-844a-14bee38a20b4 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:52.017503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab108-f2b4-421b-844a-14bee38a20b4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:52.017503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab108-f2b4-421b-844a-14bee38a20b4 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:52.019235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 652/1308] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:40:52.024501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5750-9a46-4d24-a0dc-3f1e58b7c16b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:52.024923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5750-9a46-4d24-a0dc-3f1e58b7c16b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:52.025204 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b5750-9a46-4d24-a0dc-3f1e58b7c16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:52.105403 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7f3b5750-9a46-4d24-a0dc-3f1e58b7c16b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:40:52.106627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7f3b5750-9a46-4d24-a0dc-3f1e58b7c16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:52.201061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 657/1309] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:40:52.223905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab108-f2b4-421b-844a-14bee38a20b4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:40:52.225493 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3deab108-f2b4-421b-844a-14bee38a20b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:52.344509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab108-f2b4-421b-844a-14bee38a20b4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:40:52.436779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33cdf3-cf1e-484b-a9b7-7b0a409b8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:40:52.437454 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33cdf3-cf1e-484b-a9b7-7b0a409b8e5b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:52.437741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33cdf3-cf1e-484b-a9b7-7b0a409b8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:52.438020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33cdf3-cf1e-484b-a9b7-7b0a409b8e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:52.438813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33cdf3-cf1e-484b-a9b7-7b0a409b8e5b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:40:52.440721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33cdf3-cf1e-484b-a9b7-7b0a409b8e5b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:40:52.460378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 653/1310] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:40:52 2022] GET /identity/v3/projects => generated 2553 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:40:54.712755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddc32c-a067-470d-908d-cc6df2863ef2 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:54.713309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddc32c-a067-470d-908d-cc6df2863ef2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:54.713309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddc32c-a067-470d-908d-cc6df2863ef2 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:54.715111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 658/1311] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:40:54.720601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727bc2a-a1f2-4a42-89ff-fb9384304078 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:54.720970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727bc2a-a1f2-4a42-89ff-fb9384304078 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:54.721163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727bc2a-a1f2-4a42-89ff-fb9384304078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:54.784187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6727bc2a-a1f2-4a42-89ff-fb9384304078 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:40:54.785634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6727bc2a-a1f2-4a42-89ff-fb9384304078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:54.877574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 654/1312] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:40:54.927834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999c4d1-5d3c-4e2c-b17f-401414d635c3 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:54.928155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999c4d1-5d3c-4e2c-b17f-401414d635c3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:54.928437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999c4d1-5d3c-4e2c-b17f-401414d635c3 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:54.930247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 659/1313] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jan 27 16:40:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:40:54.936230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fe80-a4ce-4297-ab01-cc07df8dcb2f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:54.936521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fe80-a4ce-4297-ab01-cc07df8dcb2f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:54.936798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fe80-a4ce-4297-ab01-cc07df8dcb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:55.007810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-4f81fe80-a4ce-4297-ab01-cc07df8dcb2f None None] MFA Rules not processed for user `15ae418635734639a4d10676978e82cf`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:40:55.008925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4f81fe80-a4ce-4297-ab01-cc07df8dcb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:55.084991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 655/1314] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jan 27 16:40:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:40:55.094927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999c4d1-5d3c-4e2c-b17f-401414d635c3 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:40:55.096484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4999c4d1-5d3c-4e2c-b17f-401414d635c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:55.194254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999c4d1-5d3c-4e2c-b17f-401414d635c3 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:40:55.266283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310d10c-ebfc-4069-a5ce-78ed3cea3aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:40:55.266924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310d10c-ebfc-4069-a5ce-78ed3cea3aec service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:55.267229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310d10c-ebfc-4069-a5ce-78ed3cea3aec service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:55.267870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310d10c-ebfc-4069-a5ce-78ed3cea3aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:55.269506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9310d10c-ebfc-4069-a5ce-78ed3cea3aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:55.494462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310d10c-ebfc-4069-a5ce-78ed3cea3aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:40:55.495880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310d10c-ebfc-4069-a5ce-78ed3cea3aec service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:40:55.514009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 660/1315] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:40:57.995758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c655-a8e0-4e30-b5c4-3b8685441157 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:57.996286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c655-a8e0-4e30-b5c4-3b8685441157 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:57.996286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205c655-a8e0-4e30-b5c4-3b8685441157 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:57.998010 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 656/1316] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:40:58.003362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa220-e790-4d6f-94f9-1f57da5665ad None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:58.003765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa220-e790-4d6f-94f9-1f57da5665ad None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:58.003955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10aa220-e790-4d6f-94f9-1f57da5665ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:58.066437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-a10aa220-e790-4d6f-94f9-1f57da5665ad None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:40:58.067632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a10aa220-e790-4d6f-94f9-1f57da5665ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:58.158630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 661/1317] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:40:58.193171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205c655-a8e0-4e30-b5c4-3b8685441157 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:40:58.194669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3205c655-a8e0-4e30-b5c4-3b8685441157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:58.313949 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205c655-a8e0-4e30-b5c4-3b8685441157 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:40:58.401855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c943f-f9b3-442b-ba5b-afb6e245a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:40:58.402798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c943f-f9b3-442b-ba5b-afb6e245a483 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:58.403182 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c943f-f9b3-442b-ba5b-afb6e245a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:58.403545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c943f-f9b3-442b-ba5b-afb6e245a483 admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:58.404649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c943f-f9b3-442b-ba5b-afb6e245a483 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e1134f718c7471d948ccfe1ca59674e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:40:58.406600 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c943f-f9b3-442b-ba5b-afb6e245a483 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:40:58.408276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 657/1318] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:40:58 2022] GET /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:40:58.421754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aa220-e790-4d6f-94f9-1f57da5665ad None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:40:58.422950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a10aa220-e790-4d6f-94f9-1f57da5665ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:58.507192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10aa220-e790-4d6f-94f9-1f57da5665ad None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:40:58.579609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbbcd2-98c7-48c3-b574-a484726664df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:40:58.580221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbbcd2-98c7-48c3-b574-a484726664df service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:40:58.580507 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbbcd2-98c7-48c3-b574-a484726664df service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:40:58.580784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbbcd2-98c7-48c3-b574-a484726664df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:40:58.582403 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-23fbbcd2-98c7-48c3-b574-a484726664df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:40:58.686436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbbcd2-98c7-48c3-b574-a484726664df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:40:58.687930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbbcd2-98c7-48c3-b574-a484726664df service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:40:58.706066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 662/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:01.188315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845eb7-7e68-4f30-8a41-4492437a8083 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:01.188897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845eb7-7e68-4f30-8a41-4492437a8083 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:01.188897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845eb7-7e68-4f30-8a41-4492437a8083 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:01.190627 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 658/1320] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:01.195853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1595d-a0be-46c2-97fb-83689fadc3dc None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:01.196231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1595d-a0be-46c2-97fb-83689fadc3dc None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:01.196407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1595d-a0be-46c2-97fb-83689fadc3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:01.259201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b4c1595d-a0be-46c2-97fb-83689fadc3dc None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:01.260512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b4c1595d-a0be-46c2-97fb-83689fadc3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:01.351652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 663/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:01.386504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845eb7-7e68-4f30-8a41-4492437a8083 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:01.388040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-91845eb7-7e68-4f30-8a41-4492437a8083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:01.510553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845eb7-7e68-4f30-8a41-4492437a8083 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:01.599869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5fa343-1df0-47ba-9720-e6922c9ad34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:01.600724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa343-1df0-47ba-9720-e6922c9ad34f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:01.601006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa343-1df0-47ba-9720-e6922c9ad34f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:01.601282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa343-1df0-47ba-9720-e6922c9ad34f admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:01.610981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fa343-1df0-47ba-9720-e6922c9ad34f admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:01.613028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5fa343-1df0-47ba-9720-e6922c9ad34f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:01.614719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 659/1322] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:41:01 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:41:01.626521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1595d-a0be-46c2-97fb-83689fadc3dc None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:01.627780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b4c1595d-a0be-46c2-97fb-83689fadc3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:01.715083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1595d-a0be-46c2-97fb-83689fadc3dc None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:01.783879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c2636-2349-4329-90a1-ef9260581a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:01.784769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c2636-2349-4329-90a1-ef9260581a27 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:01.785057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c2636-2349-4329-90a1-ef9260581a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:01.785333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c2636-2349-4329-90a1-ef9260581a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:01.786938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a28c2636-2349-4329-90a1-ef9260581a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:01.890690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c2636-2349-4329-90a1-ef9260581a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:01.892107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c2636-2349-4329-90a1-ef9260581a27 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:01.910055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 664/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:04.632700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c797d-ea2a-426e-b961-5c9d3f33d903 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:04.633218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c797d-ea2a-426e-b961-5c9d3f33d903 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:04.633310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c797d-ea2a-426e-b961-5c9d3f33d903 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:04.635050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 660/1324] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:04.640293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc53654-f7a2-4fef-a23f-bb91cd170bd2 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:04.640672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc53654-f7a2-4fef-a23f-bb91cd170bd2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:04.640862 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc53654-f7a2-4fef-a23f-bb91cd170bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:04.703928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ddc53654-f7a2-4fef-a23f-bb91cd170bd2 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:04.705136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ddc53654-f7a2-4fef-a23f-bb91cd170bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:04.796718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 665/1325] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:04.831743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c797d-ea2a-426e-b961-5c9d3f33d903 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:04.833241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a62c797d-ea2a-426e-b961-5c9d3f33d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:04.955860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c797d-ea2a-426e-b961-5c9d3f33d903 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:05.043886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb55b76-852d-4010-a4b0-33582ab19587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:05.044726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb55b76-852d-4010-a4b0-33582ab19587 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:05.045243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb55b76-852d-4010-a4b0-33582ab19587 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:05.045347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb55b76-852d-4010-a4b0-33582ab19587 admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:05.054593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb55b76-852d-4010-a4b0-33582ab19587 admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:05.057176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb55b76-852d-4010-a4b0-33582ab19587 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:05.058860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 661/1326] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:41:04 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:41:05.070051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc53654-f7a2-4fef-a23f-bb91cd170bd2 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:05.071246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ddc53654-f7a2-4fef-a23f-bb91cd170bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:05.158543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc53654-f7a2-4fef-a23f-bb91cd170bd2 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:05.228768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcc08b8-6a74-4644-823e-857ff731b4f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:05.229413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc08b8-6a74-4644-823e-857ff731b4f5 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:05.229694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc08b8-6a74-4644-823e-857ff731b4f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:05.229971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcc08b8-6a74-4644-823e-857ff731b4f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:05.231616 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ddcc08b8-6a74-4644-823e-857ff731b4f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:05.335874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc08b8-6a74-4644-823e-857ff731b4f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:05.337792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcc08b8-6a74-4644-823e-857ff731b4f5 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:05.355159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 666/1327] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:08.188675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65a5e-8143-4a2d-9db1-a4821dce4d0f None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:08.189218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65a5e-8143-4a2d-9db1-a4821dce4d0f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:08.189218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab65a5e-8143-4a2d-9db1-a4821dce4d0f None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:08.190984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 662/1328] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:08.197158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ba50-7ec8-4c6d-83ef-db06100fd6fb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:08.197641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ba50-7ec8-4c6d-83ef-db06100fd6fb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:08.197752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ba50-7ec8-4c6d-83ef-db06100fd6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:08.260033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-0971ba50-7ec8-4c6d-83ef-db06100fd6fb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:08.261201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0971ba50-7ec8-4c6d-83ef-db06100fd6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:08.353492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 667/1329] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:08.390956 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab65a5e-8143-4a2d-9db1-a4821dce4d0f None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:08.392624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7ab65a5e-8143-4a2d-9db1-a4821dce4d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:08.495670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab65a5e-8143-4a2d-9db1-a4821dce4d0f None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:08.568097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ded5f-9b2c-4d98-aa82-e0af9d3b2d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:08.568843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ded5f-9b2c-4d98-aa82-e0af9d3b2d13 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:08.569127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ded5f-9b2c-4d98-aa82-e0af9d3b2d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:08.569419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ded5f-9b2c-4d98-aa82-e0af9d3b2d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:08.571034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-648ded5f-9b2c-4d98-aa82-e0af9d3b2d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:08.678323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ded5f-9b2c-4d98-aa82-e0af9d3b2d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:08.679777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ded5f-9b2c-4d98-aa82-e0af9d3b2d13 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:08.698092 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 663/1330] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:10.994679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6df611-2639-4dcf-bea2-70c4c9d4c6d5 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:10.995294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6df611-2639-4dcf-bea2-70c4c9d4c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:10.995294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6df611-2639-4dcf-bea2-70c4c9d4c6d5 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:10.996907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 668/1331] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:11.002360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa0cae-ce78-4e68-a579-9edec9631afa None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:11.002789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa0cae-ce78-4e68-a579-9edec9631afa None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:11.002925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa0cae-ce78-4e68-a579-9edec9631afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:11.066880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1eaa0cae-ce78-4e68-a579-9edec9631afa None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:11.068110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1eaa0cae-ce78-4e68-a579-9edec9631afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:11.159501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 664/1332] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:11.211553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082fce0-dc12-4799-ac04-187f873eae13 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:11.211919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082fce0-dc12-4799-ac04-187f873eae13 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:11.212161 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082fce0-dc12-4799-ac04-187f873eae13 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:11.214651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 669/1333] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jan 27 16:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:11.220818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc18e0-28af-4aa6-aefa-3c5563a75fbe None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:11.221115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc18e0-28af-4aa6-aefa-3c5563a75fbe None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:11.221399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc18e0-28af-4aa6-aefa-3c5563a75fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:11.295262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-40cc18e0-28af-4aa6-aefa-3c5563a75fbe None None] MFA Rules not processed for user `15ae418635734639a4d10676978e82cf`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:11.296532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-40cc18e0-28af-4aa6-aefa-3c5563a75fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:11.369694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 665/1334] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jan 27 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:41:11.378610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082fce0-dc12-4799-ac04-187f873eae13 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:11.380236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9082fce0-dc12-4799-ac04-187f873eae13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:11.478416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082fce0-dc12-4799-ac04-187f873eae13 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:11.550021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa4da2-2b69-4d0f-9ed6-0d6132d60ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:11.550677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa4da2-2b69-4d0f-9ed6-0d6132d60ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:11.550961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa4da2-2b69-4d0f-9ed6-0d6132d60ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:11.551239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa4da2-2b69-4d0f-9ed6-0d6132d60ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:11.552896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-deaa4da2-2b69-4d0f-9ed6-0d6132d60ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:11.657692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa4da2-2b69-4d0f-9ed6-0d6132d60ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:11.659380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa4da2-2b69-4d0f-9ed6-0d6132d60ed1 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:11.679045 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 670/1335] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:14.200770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a382cd5-1079-49a1-995c-548a17334e37 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:14.201334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a382cd5-1079-49a1-995c-548a17334e37 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:14.201334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a382cd5-1079-49a1-995c-548a17334e37 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:14.203179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 666/1336] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:14.208478 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e7707-13a0-4c0d-bb38-af1a43ca0eb4 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:14.208903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e7707-13a0-4c0d-bb38-af1a43ca0eb4 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:14.209044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e7707-13a0-4c0d-bb38-af1a43ca0eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:14.270875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-977e7707-13a0-4c0d-bb38-af1a43ca0eb4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:14.272101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-977e7707-13a0-4c0d-bb38-af1a43ca0eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:14.366664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 671/1337] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:14.398756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a382cd5-1079-49a1-995c-548a17334e37 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:14.401004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7a382cd5-1079-49a1-995c-548a17334e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:14.525382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a382cd5-1079-49a1-995c-548a17334e37 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:14.615778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28cca8-b998-41bf-a6b3-c9afdefc213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:14.616638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cca8-b998-41bf-a6b3-c9afdefc213f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:14.616915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cca8-b998-41bf-a6b3-c9afdefc213f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:14.617188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cca8-b998-41bf-a6b3-c9afdefc213f admin admin] PATH_INFO: `/v3/projects/9fb3d018836e4765a6346dd80809dc63` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:14.627504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28cca8-b998-41bf-a6b3-c9afdefc213f admin admin] RBAC: Authorizing `identity:get_project(project_id=9fb3d018836e4765a6346dd80809dc63)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:14.629582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28cca8-b998-41bf-a6b3-c9afdefc213f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:14.631312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 667/1338] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:41:14 2022] GET /identity/v3/projects/9fb3d018836e4765a6346dd80809dc63 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:41:14.643434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e7707-13a0-4c0d-bb38-af1a43ca0eb4 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:14.644667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-977e7707-13a0-4c0d-bb38-af1a43ca0eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:14.735661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e7707-13a0-4c0d-bb38-af1a43ca0eb4 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:14.808311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7e770-b8b9-4e58-89d5-000446f68ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:14.808875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e770-b8b9-4e58-89d5-000446f68ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:14.809155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e770-b8b9-4e58-89d5-000446f68ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:14.809427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7e770-b8b9-4e58-89d5-000446f68ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:14.811042 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8fa7e770-b8b9-4e58-89d5-000446f68ee9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:14.921981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7e770-b8b9-4e58-89d5-000446f68ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:14.923429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7e770-b8b9-4e58-89d5-000446f68ee9 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:14.943734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 672/1339] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:17.662868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64212873-43e7-470c-80a6-643481dbbe59 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:17.663387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64212873-43e7-470c-80a6-643481dbbe59 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:17.663387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64212873-43e7-470c-80a6-643481dbbe59 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:17.665912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 668/1340] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:17.671373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca99dd7-b24a-4102-875c-5b22c72840ae None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:17.671856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca99dd7-b24a-4102-875c-5b22c72840ae None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:17.672112 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca99dd7-b24a-4102-875c-5b22c72840ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:17.738526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-0ca99dd7-b24a-4102-875c-5b22c72840ae None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:17.739994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0ca99dd7-b24a-4102-875c-5b22c72840ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:17.837870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 673/1341] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:17.875709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64212873-43e7-470c-80a6-643481dbbe59 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:17.877216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-64212873-43e7-470c-80a6-643481dbbe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:17.978243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64212873-43e7-470c-80a6-643481dbbe59 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:18.048438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37108a-4901-4f7e-9fc6-e016940b2c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:18.049082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37108a-4901-4f7e-9fc6-e016940b2c70 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:18.049362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37108a-4901-4f7e-9fc6-e016940b2c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:18.049634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37108a-4901-4f7e-9fc6-e016940b2c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:18.051254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1f37108a-4901-4f7e-9fc6-e016940b2c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:18.156853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37108a-4901-4f7e-9fc6-e016940b2c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:18.158284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37108a-4901-4f7e-9fc6-e016940b2c70 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:18.177187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 669/1342] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:20.449304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ec055-ea73-4688-ac3b-7c0a87fff5e0 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:20.449881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ec055-ea73-4688-ac3b-7c0a87fff5e0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:20.449881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ec055-ea73-4688-ac3b-7c0a87fff5e0 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:20.451655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 674/1343] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:20.457013 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fe79-3278-4b66-8ed8-b5302b1948a2 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:20.457436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fe79-3278-4b66-8ed8-b5302b1948a2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:20.457575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0fe79-3278-4b66-8ed8-b5302b1948a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:20.526938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6af0fe79-3278-4b66-8ed8-b5302b1948a2 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:20.528141 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6af0fe79-3278-4b66-8ed8-b5302b1948a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:20.627328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 670/1344] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:20.663650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ec055-ea73-4688-ac3b-7c0a87fff5e0 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:20.676492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ec055-ea73-4688-ac3b-7c0a87fff5e0 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:20.681360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370a2dc-d1d9-4ce1-9312-45001ea8c0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:20.682194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370a2dc-d1d9-4ce1-9312-45001ea8c0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:20.682471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370a2dc-d1d9-4ce1-9312-45001ea8c0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:20.682743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370a2dc-d1d9-4ce1-9312-45001ea8c0b4 admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:20.683950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370a2dc-d1d9-4ce1-9312-45001ea8c0b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e1134f718c7471d948ccfe1ca59674e)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:20.685764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370a2dc-d1d9-4ce1-9312-45001ea8c0b4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:20.687394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 675/1345] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:41:20 2022] GET /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:41:20.699808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0fe79-3278-4b66-8ed8-b5302b1948a2 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:20.701171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6af0fe79-3278-4b66-8ed8-b5302b1948a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:20.789712 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0fe79-3278-4b66-8ed8-b5302b1948a2 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:20.793364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6894c6-c020-4b3d-ae60-8502b3cdb35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:20.793999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6894c6-c020-4b3d-ae60-8502b3cdb35c service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:20.794281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6894c6-c020-4b3d-ae60-8502b3cdb35c service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:20.794557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6894c6-c020-4b3d-ae60-8502b3cdb35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:20.803088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6894c6-c020-4b3d-ae60-8502b3cdb35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:20.804536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6894c6-c020-4b3d-ae60-8502b3cdb35c service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:20.815969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 671/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:23.506629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31968f8-41ee-4e01-8eae-aba51f85b421 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:23.507165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31968f8-41ee-4e01-8eae-aba51f85b421 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:23.507165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31968f8-41ee-4e01-8eae-aba51f85b421 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:23.509457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 676/1347] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:23.514505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e8d8-04ee-4e6d-8955-eef205a5dc88 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:23.514947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e8d8-04ee-4e6d-8955-eef205a5dc88 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:23.515059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3e8d8-04ee-4e6d-8955-eef205a5dc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:23.533304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d7f3e8d8-04ee-4e6d-8955-eef205a5dc88 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:23.534720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d7f3e8d8-04ee-4e6d-8955-eef205a5dc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:23.542868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 672/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:23.578567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31968f8-41ee-4e01-8eae-aba51f85b421 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:23.589474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31968f8-41ee-4e01-8eae-aba51f85b421 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:23.592922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae1ab5-41bd-4129-b91a-52a708656697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:23.593549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1ab5-41bd-4129-b91a-52a708656697 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:23.593833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1ab5-41bd-4129-b91a-52a708656697 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:23.594113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae1ab5-41bd-4129-b91a-52a708656697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:23.602633 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1ab5-41bd-4129-b91a-52a708656697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:23.604084 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae1ab5-41bd-4129-b91a-52a708656697 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:23.613063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 677/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:27.808386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c6a8-c888-4677-b564-55eb4ddb1973 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:27.808909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c6a8-c888-4677-b564-55eb4ddb1973 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:27.808909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1c6a8-c888-4677-b564-55eb4ddb1973 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:27.810710 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 673/1350] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:27.815944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bfa57-5852-41a3-a034-5e114398739e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:27.816340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bfa57-5852-41a3-a034-5e114398739e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:27.816505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bfa57-5852-41a3-a034-5e114398739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:27.835539 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d33bfa57-5852-41a3-a034-5e114398739e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:27.837358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d33bfa57-5852-41a3-a034-5e114398739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:27.845112 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 678/1351] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:27.869613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c6a8-c888-4677-b564-55eb4ddb1973 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:27.880742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1c6a8-c888-4677-b564-55eb4ddb1973 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:27.885921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e26c64-8c48-435f-9cac-2827be8082c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:27.886564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26c64-8c48-435f-9cac-2827be8082c1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:27.886845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26c64-8c48-435f-9cac-2827be8082c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:27.887139 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e26c64-8c48-435f-9cac-2827be8082c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:27.887916 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e26c64-8c48-435f-9cac-2827be8082c1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:27.889767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e26c64-8c48-435f-9cac-2827be8082c1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:27.915596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 674/1352] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:41:27 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:41:30.130400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686d3e-626d-4420-9096-16f37bc637e5 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:30.130989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686d3e-626d-4420-9096-16f37bc637e5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:30.130989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28686d3e-626d-4420-9096-16f37bc637e5 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:30.132785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 679/1353] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:30.139057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923826b-6b10-41ad-a460-943c4bc9e38d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:30.139489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923826b-6b10-41ad-a460-943c4bc9e38d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:30.139796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923826b-6b10-41ad-a460-943c4bc9e38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:30.157843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1923826b-6b10-41ad-a460-943c4bc9e38d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:30.159273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1923826b-6b10-41ad-a460-943c4bc9e38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:30.167325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 675/1354] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:30.200971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686d3e-626d-4420-9096-16f37bc637e5 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:30.214070 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28686d3e-626d-4420-9096-16f37bc637e5 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:30.218443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dd4a5-c8bf-47b2-bda4-1f2db5f9fceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:30.219285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd4a5-c8bf-47b2-bda4-1f2db5f9fceb admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:30.219587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd4a5-c8bf-47b2-bda4-1f2db5f9fceb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:30.219875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd4a5-c8bf-47b2-bda4-1f2db5f9fceb admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:30.221110 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1dd4a5-c8bf-47b2-bda4-1f2db5f9fceb admin admin] RBAC: Authorizing `identity:get_project(project_id=0e1134f718c7471d948ccfe1ca59674e)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:30.222907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1dd4a5-c8bf-47b2-bda4-1f2db5f9fceb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:30.224608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 680/1355] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:41:30 2022] GET /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:41:30.236215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923826b-6b10-41ad-a460-943c4bc9e38d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:30.245612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923826b-6b10-41ad-a460-943c4bc9e38d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:30.249108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc32d87-6751-43a1-9b12-e71f0b1afba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:30.249743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc32d87-6751-43a1-9b12-e71f0b1afba3 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:30.250024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc32d87-6751-43a1-9b12-e71f0b1afba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:30.250298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc32d87-6751-43a1-9b12-e71f0b1afba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:30.259847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc32d87-6751-43a1-9b12-e71f0b1afba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:30.261278 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc32d87-6751-43a1-9b12-e71f0b1afba3 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:30.270831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 676/1356] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:33.102188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d1a0-74fa-4cab-85bd-0a65f5dac002 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:33.102954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d1a0-74fa-4cab-85bd-0a65f5dac002 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:33.102954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d1a0-74fa-4cab-85bd-0a65f5dac002 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:33.104527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 681/1357] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:33.109660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61d101-fe68-4bae-90a6-d4d3c12e05d4 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:33.110065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61d101-fe68-4bae-90a6-d4d3c12e05d4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:33.110212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61d101-fe68-4bae-90a6-d4d3c12e05d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:33.129140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ca61d101-fe68-4bae-90a6-d4d3c12e05d4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:33.130337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ca61d101-fe68-4bae-90a6-d4d3c12e05d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:33.138688 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 677/1358] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:33.176282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d1a0-74fa-4cab-85bd-0a65f5dac002 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:33.187717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d1a0-74fa-4cab-85bd-0a65f5dac002 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:33.191323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29241189-8462-4739-a738-492689e47680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:33.192055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241189-8462-4739-a738-492689e47680 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:33.192373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241189-8462-4739-a738-492689e47680 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:33.192688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29241189-8462-4739-a738-492689e47680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:33.203167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29241189-8462-4739-a738-492689e47680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:33.204725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29241189-8462-4739-a738-492689e47680 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:33.216499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 682/1359] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:37.551681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6b558-392f-48ae-97df-094b7c50f206 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:37.552184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6b558-392f-48ae-97df-094b7c50f206 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:37.552184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6b558-392f-48ae-97df-094b7c50f206 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:37.553926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 678/1360] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:37.559885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799f9d-4f99-4067-8e8b-0f1d86417b67 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:37.560320 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799f9d-4f99-4067-8e8b-0f1d86417b67 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:37.560427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24799f9d-4f99-4067-8e8b-0f1d86417b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:37.577932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-24799f9d-4f99-4067-8e8b-0f1d86417b67 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:37.579145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-24799f9d-4f99-4067-8e8b-0f1d86417b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:37.588446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 683/1361] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:37.627772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6b558-392f-48ae-97df-094b7c50f206 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:37.654759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6b558-392f-48ae-97df-094b7c50f206 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:37.660165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbea731-6315-4c2c-84e4-095de6279e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:37.661057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbea731-6315-4c2c-84e4-095de6279e89 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:37.661330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbea731-6315-4c2c-84e4-095de6279e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:37.661607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbea731-6315-4c2c-84e4-095de6279e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:37.672748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbea731-6315-4c2c-84e4-095de6279e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:37.674248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbea731-6315-4c2c-84e4-095de6279e89 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:37.689724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 679/1362] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:42.762856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182a757-7796-4d5e-887d-eb04c9383d08 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:42.763428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182a757-7796-4d5e-887d-eb04c9383d08 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:42.763428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182a757-7796-4d5e-887d-eb04c9383d08 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:42.765199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 684/1363] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jan 27 16:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:42.771209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32fa22-6783-45e4-90a4-da74a128a270 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:42.772037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32fa22-6783-45e4-90a4-da74a128a270 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:42.772488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32fa22-6783-45e4-90a4-da74a128a270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:42.845518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-5e32fa22-6783-45e4-90a4-da74a128a270 None None] MFA Rules not processed for user `6f5bbcf690d144ab99438b3f65b5e100`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:42.846922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5e32fa22-6783-45e4-90a4-da74a128a270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:42.919371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 680/1364] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jan 27 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:47.089156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dd918-dc0c-43da-84da-7c1cc1af270c None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:47.089673 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dd918-dc0c-43da-84da-7c1cc1af270c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:47.089775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8dd918-dc0c-43da-84da-7c1cc1af270c None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:47.091762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 685/1365] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jan 27 16:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:47.096966 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825035b5-aa95-46db-9ddc-d26588b6dd1b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:47.097368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825035b5-aa95-46db-9ddc-d26588b6dd1b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:47.097664 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825035b5-aa95-46db-9ddc-d26588b6dd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:47.116649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-825035b5-aa95-46db-9ddc-d26588b6dd1b None None] MFA Rules not processed for user `6f5bbcf690d144ab99438b3f65b5e100`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:47.117937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-825035b5-aa95-46db-9ddc-d26588b6dd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:47.126619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 681/1366] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jan 27 16:41:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:48.709726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9da4d-b1ef-41b8-a087-d78cdd364894 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:48.710717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9da4d-b1ef-41b8-a087-d78cdd364894 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:48.710890 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9da4d-b1ef-41b8-a087-d78cdd364894 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:48.712741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 686/1367] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jan 27 16:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:48.717756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe333d4-c63a-4c62-b8b2-8156c7d64b7c None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:48.718173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe333d4-c63a-4c62-b8b2-8156c7d64b7c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:48.718324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe333d4-c63a-4c62-b8b2-8156c7d64b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:48.736133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1fe333d4-c63a-4c62-b8b2-8156c7d64b7c None None] MFA Rules not processed for user `6f5bbcf690d144ab99438b3f65b5e100`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:48.737325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1fe333d4-c63a-4c62-b8b2-8156c7d64b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:48.746315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 682/1368] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jan 27 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:41:52.626793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdde60-0f7e-419b-a57b-a0f412a7178a None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:52.627338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdde60-0f7e-419b-a57b-a0f412a7178a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:52.627338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdde60-0f7e-419b-a57b-a0f412a7178a None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:52.629267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 687/1369] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:41:52.634652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193f0c6-1b87-4810-814a-b18c6a1a2a95 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:52.635088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193f0c6-1b87-4810-814a-b18c6a1a2a95 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:52.635204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193f0c6-1b87-4810-814a-b18c6a1a2a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:52.653787 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9193f0c6-1b87-4810-814a-b18c6a1a2a95 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:52.655248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9193f0c6-1b87-4810-814a-b18c6a1a2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:52.665129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 683/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:52.715895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55442-15b9-492b-8b93-b6bf9e29e5bb None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:52.716296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55442-15b9-492b-8b93-b6bf9e29e5bb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:52.716662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e55442-15b9-492b-8b93-b6bf9e29e5bb None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:52.718594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 688/1371] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jan 27 16:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:52.723947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034613-b1f5-4390-9cf9-1eb0f263a789 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:52.724361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034613-b1f5-4390-9cf9-1eb0f263a789 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:52.724843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034613-b1f5-4390-9cf9-1eb0f263a789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:52.774696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d5034613-b1f5-4390-9cf9-1eb0f263a789 None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:52.775891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d5034613-b1f5-4390-9cf9-1eb0f263a789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:52.860208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 684/1372] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jan 27 16:41:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:52.868212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55442-15b9-492b-8b93-b6bf9e29e5bb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:52.883433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e55442-15b9-492b-8b93-b6bf9e29e5bb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:52.888922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4c38b-b68a-425d-9d5f-a0a61be2bb7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:52.889663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c38b-b68a-425d-9d5f-a0a61be2bb7d service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:52.890025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c38b-b68a-425d-9d5f-a0a61be2bb7d service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:52.890378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4c38b-b68a-425d-9d5f-a0a61be2bb7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:52.899641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4c38b-b68a-425d-9d5f-a0a61be2bb7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:52.901303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4c38b-b68a-425d-9d5f-a0a61be2bb7d service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:52.913193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 689/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:55.354087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba585d-7ced-4224-a598-6279ce15451d None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:55.354613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba585d-7ced-4224-a598-6279ce15451d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:55.354613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba585d-7ced-4224-a598-6279ce15451d None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:55.356538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 685/1374] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:55.361608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a29926-098a-4a62-8f01-2cbd166d6490 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:55.362001 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a29926-098a-4a62-8f01-2cbd166d6490 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:55.362163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a29926-098a-4a62-8f01-2cbd166d6490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:55.380533 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-44a29926-098a-4a62-8f01-2cbd166d6490 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:55.382296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-44a29926-098a-4a62-8f01-2cbd166d6490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:55.390352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 690/1375] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:55.434940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba585d-7ced-4224-a598-6279ce15451d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:55.450168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba585d-7ced-4224-a598-6279ce15451d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:55.456016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449d47f-e449-40ae-9ae0-51240aa1d82a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:55.456842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d47f-e449-40ae-9ae0-51240aa1d82a service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:55.457279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d47f-e449-40ae-9ae0-51240aa1d82a service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:55.457707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d47f-e449-40ae-9ae0-51240aa1d82a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:55.466929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449d47f-e449-40ae-9ae0-51240aa1d82a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:55.468719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449d47f-e449-40ae-9ae0-51240aa1d82a service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:55.481058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 686/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:41:58.043232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2a02a-7be9-4e7d-ad15-f4e7d98c23bc None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:58.043735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2a02a-7be9-4e7d-ad15-f4e7d98c23bc None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:58.043735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2a02a-7be9-4e7d-ad15-f4e7d98c23bc None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:58.045543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 691/1377] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:58.050966 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f0c2f-eef7-45e2-9d09-62a41ee1db60 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:58.051356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f0c2f-eef7-45e2-9d09-62a41ee1db60 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:58.051670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6f0c2f-eef7-45e2-9d09-62a41ee1db60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:58.070701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-0d6f0c2f-eef7-45e2-9d09-62a41ee1db60 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:58.072024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0d6f0c2f-eef7-45e2-9d09-62a41ee1db60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:58.079816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 687/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:58.125406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09c16-f9b4-42d0-a1a2-e1c16e0c640c None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:58.125693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09c16-f9b4-42d0-a1a2-e1c16e0c640c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:58.125968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09c16-f9b4-42d0-a1a2-e1c16e0c640c None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:58.128112 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 692/1379] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jan 27 16:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:41:58.133979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b98e7-0cf0-42fb-8e12-1c3f77b2711e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:58.134269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b98e7-0cf0-42fb-8e12-1c3f77b2711e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:58.134547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5b98e7-0cf0-42fb-8e12-1c3f77b2711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:58.152414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6b5b98e7-0cf0-42fb-8e12-1c3f77b2711e None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:41:58.153574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6b5b98e7-0cf0-42fb-8e12-1c3f77b2711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:41:58.163378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 688/1380] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jan 27 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:41:58.170765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09c16-f9b4-42d0-a1a2-e1c16e0c640c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:41:58.185628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09c16-f9b4-42d0-a1a2-e1c16e0c640c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:41:58.191156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d9f50-2a5e-4460-95ea-64e8364ac612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:41:58.191827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d9f50-2a5e-4460-95ea-64e8364ac612 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:41:58.192114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d9f50-2a5e-4460-95ea-64e8364ac612 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:41:58.192395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d9f50-2a5e-4460-95ea-64e8364ac612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:41:58.200674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d9f50-2a5e-4460-95ea-64e8364ac612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:41:58.202306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d9f50-2a5e-4460-95ea-64e8364ac612 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:41:58.212123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 693/1381] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:42:00.516258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038d2e-977e-460a-b255-13806f3daa10 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:00.516799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038d2e-977e-460a-b255-13806f3daa10 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:00.516879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038d2e-977e-460a-b255-13806f3daa10 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:00.518865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 689/1382] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:00.525270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba5708-f613-4688-87c2-7d1b3ca1fd69 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:00.525878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba5708-f613-4688-87c2-7d1b3ca1fd69 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:00.526035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba5708-f613-4688-87c2-7d1b3ca1fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:00.549350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8bba5708-f613-4688-87c2-7d1b3ca1fd69 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:00.550587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8bba5708-f613-4688-87c2-7d1b3ca1fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:00.559162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 694/1383] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:00.604669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038d2e-977e-460a-b255-13806f3daa10 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:00.620036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038d2e-977e-460a-b255-13806f3daa10 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:00.625680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258bb85-08d3-4cde-9572-03b289b8ec02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:00.626426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258bb85-08d3-4cde-9572-03b289b8ec02 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:00.626818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258bb85-08d3-4cde-9572-03b289b8ec02 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:00.627217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258bb85-08d3-4cde-9572-03b289b8ec02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:00.637128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258bb85-08d3-4cde-9572-03b289b8ec02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:00.638924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258bb85-08d3-4cde-9572-03b289b8ec02 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:00.649524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 690/1384] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:00.765225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76050818-2133-4b60-8bfe-d6a15995e5d2 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:00.765855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76050818-2133-4b60-8bfe-d6a15995e5d2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:00.766385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76050818-2133-4b60-8bfe-d6a15995e5d2 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:00.768651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 695/1385] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:00.776036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e200bb-3215-41d2-85de-156782df0067 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:00.776627 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e200bb-3215-41d2-85de-156782df0067 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:00.777051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e200bb-3215-41d2-85de-156782df0067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:00.797690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d5e200bb-3215-41d2-85de-156782df0067 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:00.799236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d5e200bb-3215-41d2-85de-156782df0067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:00.808287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 691/1386] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:01.068313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41527-4d08-4664-a6cf-961311a3c442 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:01.069274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41527-4d08-4664-a6cf-961311a3c442 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:01.069665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa41527-4d08-4664-a6cf-961311a3c442 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:01.071721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 696/1387] 10.222.0.48 () {54 vars in 963 bytes} [Thu Jan 27 16:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:01.077943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3beca-5031-454e-9d8f-01ee5b86c5ee None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:01.078586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3beca-5031-454e-9d8f-01ee5b86c5ee None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:01.078871 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3beca-5031-454e-9d8f-01ee5b86c5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:01.132479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-26d3beca-5031-454e-9d8f-01ee5b86c5ee None None] MFA Rules not processed for user `a62aede1113047fc80983b85ae0cbfe2`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:01.133702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-26d3beca-5031-454e-9d8f-01ee5b86c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:01.192977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 692/1388] 10.222.0.48 () {58 vars in 1060 bytes} [Thu Jan 27 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:01.200764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41527-4d08-4664-a6cf-961311a3c442 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:01.211956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa41527-4d08-4664-a6cf-961311a3c442 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:01.215409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7b47-08dc-4c43-9520-4500660b1e4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:01.216073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7b47-08dc-4c43-9520-4500660b1e4a service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:01.216354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7b47-08dc-4c43-9520-4500660b1e4a service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:01.216626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7b47-08dc-4c43-9520-4500660b1e4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:01.226215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7b47-08dc-4c43-9520-4500660b1e4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:01.227758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7b47-08dc-4c43-9520-4500660b1e4a service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:01.237274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 697/1389] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:02.992722 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458043f-40e2-4408-8300-d8b2e1dc7a76 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:02.993210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458043f-40e2-4408-8300-d8b2e1dc7a76 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:02.993301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458043f-40e2-4408-8300-d8b2e1dc7a76 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:02.995045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 693/1390] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:03.000597 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6594ef-002e-4620-bf04-634b3ce9067b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:03.001034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6594ef-002e-4620-bf04-634b3ce9067b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:03.001162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6594ef-002e-4620-bf04-634b3ce9067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:03.019726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-6b6594ef-002e-4620-bf04-634b3ce9067b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:03.020504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6b6594ef-002e-4620-bf04-634b3ce9067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:03.029575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 698/1391] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:03.075061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458043f-40e2-4408-8300-d8b2e1dc7a76 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:03.091940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458043f-40e2-4408-8300-d8b2e1dc7a76 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:03.097487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c44a33-40cc-46d2-a2b6-39283701d1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:03.098136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c44a33-40cc-46d2-a2b6-39283701d1af service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:03.098422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c44a33-40cc-46d2-a2b6-39283701d1af service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:03.098701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c44a33-40cc-46d2-a2b6-39283701d1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:03.108223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c44a33-40cc-46d2-a2b6-39283701d1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:03.109824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c44a33-40cc-46d2-a2b6-39283701d1af service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:03.120511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 694/1392] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:05.437726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782237c-9fb0-4ad7-8b26-72879f667bde None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:05.438208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782237c-9fb0-4ad7-8b26-72879f667bde None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:05.438208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c782237c-9fb0-4ad7-8b26-72879f667bde None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:05.439979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 699/1393] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:42:05.445891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7cd3-d2fa-472f-b5b3-55bfd088e304 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:05.446362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7cd3-d2fa-472f-b5b3-55bfd088e304 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:05.446519 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c7cd3-d2fa-472f-b5b3-55bfd088e304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:05.464969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e65c7cd3-d2fa-472f-b5b3-55bfd088e304 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:05.466164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e65c7cd3-d2fa-472f-b5b3-55bfd088e304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:05.474086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 695/1394] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:05.519270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782237c-9fb0-4ad7-8b26-72879f667bde None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:05.534471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c782237c-9fb0-4ad7-8b26-72879f667bde None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:05.540591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2781f11-cb2a-4bb8-8474-434d6f14d5f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:05.541370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781f11-cb2a-4bb8-8474-434d6f14d5f5 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:05.541664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781f11-cb2a-4bb8-8474-434d6f14d5f5 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:05.541945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2781f11-cb2a-4bb8-8474-434d6f14d5f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:05.556886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2781f11-cb2a-4bb8-8474-434d6f14d5f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:05.558479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2781f11-cb2a-4bb8-8474-434d6f14d5f5 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:05.568423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 700/1395] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:07.841384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b88155-2180-4d74-9049-b40f7d9a5dce None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:07.841891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b88155-2180-4d74-9049-b40f7d9a5dce None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:07.841891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b88155-2180-4d74-9049-b40f7d9a5dce None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:07.843804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 696/1396] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:07.848863 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9210b72-6aa5-4e62-81bf-84d45783274e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:07.849291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9210b72-6aa5-4e62-81bf-84d45783274e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:07.849415 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9210b72-6aa5-4e62-81bf-84d45783274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:07.870073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b9210b72-6aa5-4e62-81bf-84d45783274e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:07.871248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b9210b72-6aa5-4e62-81bf-84d45783274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:07.879269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 701/1397] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:07.922235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b88155-2180-4d74-9049-b40f7d9a5dce None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:07.937864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b88155-2180-4d74-9049-b40f7d9a5dce None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:07.943702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb8248-3557-42de-b496-1ea4eb32eaa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:07.944644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8248-3557-42de-b496-1ea4eb32eaa6 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:07.944932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8248-3557-42de-b496-1ea4eb32eaa6 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:07.945200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb8248-3557-42de-b496-1ea4eb32eaa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:07.954264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb8248-3557-42de-b496-1ea4eb32eaa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:07.955935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb8248-3557-42de-b496-1ea4eb32eaa6 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:07.967101 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 697/1398] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:10.312620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc3cd-237a-47af-8cbe-4c085159e35b None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:10.313291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc3cd-237a-47af-8cbe-4c085159e35b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:10.313291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedc3cd-237a-47af-8cbe-4c085159e35b None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:10.315003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 702/1399] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:10.320491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771b11-1595-468b-9adb-24ca62bb17b5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:10.320964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771b11-1595-468b-9adb-24ca62bb17b5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:10.321118 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c771b11-1595-468b-9adb-24ca62bb17b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:10.339016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-0c771b11-1595-468b-9adb-24ca62bb17b5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:10.340222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0c771b11-1595-468b-9adb-24ca62bb17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:10.348988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 698/1400] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:10.392814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc3cd-237a-47af-8cbe-4c085159e35b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:10.408240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedc3cd-237a-47af-8cbe-4c085159e35b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:10.414783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4bca4-784f-4abb-b648-d452d0507187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:10.415430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4bca4-784f-4abb-b648-d452d0507187 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:10.415745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4bca4-784f-4abb-b648-d452d0507187 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:10.416024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4bca4-784f-4abb-b648-d452d0507187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:10.424333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4bca4-784f-4abb-b648-d452d0507187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:10.425925 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4bca4-784f-4abb-b648-d452d0507187 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:10.435631 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 703/1401] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:12.683276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c95847-afbe-495a-83fc-17ef2858db4a None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:12.683932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c95847-afbe-495a-83fc-17ef2858db4a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:12.683932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c95847-afbe-495a-83fc-17ef2858db4a None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:12.685632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 699/1402] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:42:12.691398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3202-4ea0-4fc4-b414-c6e71662f80d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:12.691909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3202-4ea0-4fc4-b414-c6e71662f80d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:12.692021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f3202-4ea0-4fc4-b414-c6e71662f80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:12.711769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8b9f3202-4ea0-4fc4-b414-c6e71662f80d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:12.713250 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8b9f3202-4ea0-4fc4-b414-c6e71662f80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:12.721602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 704/1403] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:42:12.769028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c95847-afbe-495a-83fc-17ef2858db4a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:12.783472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c95847-afbe-495a-83fc-17ef2858db4a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:12.791237 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2519e9b-fa66-4a23-a277-b382460bd370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:12.792059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519e9b-fa66-4a23-a277-b382460bd370 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:12.792344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519e9b-fa66-4a23-a277-b382460bd370 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:12.792624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519e9b-fa66-4a23-a277-b382460bd370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:12.801318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2519e9b-fa66-4a23-a277-b382460bd370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:12.803220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2519e9b-fa66-4a23-a277-b382460bd370 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:12.813357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 700/1404] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:15.096329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9b30e-1397-4327-bbf2-c31d51236182 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:15.096741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9b30e-1397-4327-bbf2-c31d51236182 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:15.096883 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9b30e-1397-4327-bbf2-c31d51236182 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:15.098654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 705/1405] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:42:15.105084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adeb76-bebb-4d7b-b1a9-11ee4435bceb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:15.105535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adeb76-bebb-4d7b-b1a9-11ee4435bceb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:15.105662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5adeb76-bebb-4d7b-b1a9-11ee4435bceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:15.123975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b5adeb76-bebb-4d7b-b1a9-11ee4435bceb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:15.125351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b5adeb76-bebb-4d7b-b1a9-11ee4435bceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:15.133048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 701/1406] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:15.177349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9b30e-1397-4327-bbf2-c31d51236182 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:15.191966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9b30e-1397-4327-bbf2-c31d51236182 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:15.197680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4559aec-9389-4476-b8e7-d77ad692bf5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:15.198321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4559aec-9389-4476-b8e7-d77ad692bf5f service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:15.198629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4559aec-9389-4476-b8e7-d77ad692bf5f service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:15.198892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4559aec-9389-4476-b8e7-d77ad692bf5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:15.206750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4559aec-9389-4476-b8e7-d77ad692bf5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:15.208389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4559aec-9389-4476-b8e7-d77ad692bf5f service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:15.217825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 706/1407] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:16.497976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4b319-92dc-4267-b1eb-740dc4691df2 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:16.498544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4b319-92dc-4267-b1eb-740dc4691df2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:16.498544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4b319-92dc-4267-b1eb-740dc4691df2 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:16.500502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 702/1408] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:16.505938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4e177-fa4d-4cac-b23b-ff80d5b2aff5 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:16.506446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4e177-fa4d-4cac-b23b-ff80d5b2aff5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:16.506547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4e177-fa4d-4cac-b23b-ff80d5b2aff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:16.528662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8eb4e177-fa4d-4cac-b23b-ff80d5b2aff5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:16.529868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8eb4e177-fa4d-4cac-b23b-ff80d5b2aff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:16.548280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 707/1409] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:16.603168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4401c-5460-4372-b2ed-ecca22c6ecda None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:16.603548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4401c-5460-4372-b2ed-ecca22c6ecda None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:16.603946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4401c-5460-4372-b2ed-ecca22c6ecda None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:16.605790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 703/1410] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jan 27 16:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:16.610800 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837cd7-31ea-47ca-a0cd-f3b112963e06 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:16.611040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837cd7-31ea-47ca-a0cd-f3b112963e06 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:16.611329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1837cd7-31ea-47ca-a0cd-f3b112963e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:16.658874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e1837cd7-31ea-47ca-a0cd-f3b112963e06 None None] MFA Rules not processed for user `295fe8f61f87423bb49471e2f0085690`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:16.660124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e1837cd7-31ea-47ca-a0cd-f3b112963e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:16.718419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 708/1411] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jan 27 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:16.725980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4401c-5460-4372-b2ed-ecca22c6ecda None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:16.736273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4401c-5460-4372-b2ed-ecca22c6ecda None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:16.739758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c7b20-3267-45a7-b2e5-ef2cc68aac8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '295fe8f61f87423bb49471e2f0085690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:16.740706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c7b20-3267-45a7-b2e5-ef2cc68aac8c service glance] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:16.740994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c7b20-3267-45a7-b2e5-ef2cc68aac8c service glance] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:16.741265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c7b20-3267-45a7-b2e5-ef2cc68aac8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:16.749871 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c7b20-3267-45a7-b2e5-ef2cc68aac8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:16.751330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c7b20-3267-45a7-b2e5-ef2cc68aac8c service glance] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:16.761211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 704/1412] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:17.185802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf10c95-f5bd-474c-81a7-0820e3c2c50f None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:17.186158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf10c95-f5bd-474c-81a7-0820e3c2c50f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:17.186505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf10c95-f5bd-474c-81a7-0820e3c2c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:17.236063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2bf10c95-f5bd-474c-81a7-0820e3c2c50f None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:17.237175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2bf10c95-f5bd-474c-81a7-0820e3c2c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:17.305827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 709/1413] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:17.347762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2d305-a310-4526-9daf-c9dd2691c068 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:17.348059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2d305-a310-4526-9daf-c9dd2691c068 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:17.348343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2d305-a310-4526-9daf-c9dd2691c068 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:17.350773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 705/1414] 10.222.0.48 () {54 vars in 942 bytes} [Thu Jan 27 16:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:17.357398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f02660-7944-437c-aa2f-45dc2d1a5994 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:17.357815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f02660-7944-437c-aa2f-45dc2d1a5994 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:17.358095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f02660-7944-437c-aa2f-45dc2d1a5994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:17.421579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-49f02660-7944-437c-aa2f-45dc2d1a5994 None None] MFA Rules not processed for user `e14c278fc5654bb9ae7c05d4ba023262`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:17.422762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-49f02660-7944-437c-aa2f-45dc2d1a5994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:17.492701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 710/1415] 10.222.0.48 () {58 vars in 1039 bytes} [Thu Jan 27 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:17.502417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2d305-a310-4526-9daf-c9dd2691c068 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:17.506856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385fee3-c451-45ea-b04d-c04237598bba None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:17.507296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385fee3-c451-45ea-b04d-c04237598bba None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:17.507296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385fee3-c451-45ea-b04d-c04237598bba None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:17.509049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 711/1416] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:42:17.514124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29943-7b59-4c24-a80d-f2faeacd11b1 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:17.514414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29943-7b59-4c24-a80d-f2faeacd11b1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:17.514695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da29943-7b59-4c24-a80d-f2faeacd11b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:17.517703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2d305-a310-4526-9daf-c9dd2691c068 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:17.523393 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb60c-76df-46f5-a833-cb9d80e43ae7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:17.524139 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb60c-76df-46f5-a833-cb9d80e43ae7 service swift] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:17.524548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb60c-76df-46f5-a833-cb9d80e43ae7 service swift] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:17.524837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebb60c-76df-46f5-a833-cb9d80e43ae7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:17.532940 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3da29943-7b59-4c24-a80d-f2faeacd11b1 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:17.533953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebb60c-76df-46f5-a833-cb9d80e43ae7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:17.534130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3da29943-7b59-4c24-a80d-f2faeacd11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:17.535529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cebb60c-76df-46f5-a833-cb9d80e43ae7 service swift] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:17.546051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 706/1417] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:42:17.551964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 712/1418] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:42:17.587992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb60c-76df-46f5-a833-cb9d80e43ae7 service swift] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:17.599863 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cebb60c-76df-46f5-a833-cb9d80e43ae7 service swift] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:17.605450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccaabe-3efb-4891-bf25-c32a101421f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:17.606200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccaabe-3efb-4891-bf25-c32a101421f1 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:17.606729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccaabe-3efb-4891-bf25-c32a101421f1 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:17.607046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccaabe-3efb-4891-bf25-c32a101421f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:17.616290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccaabe-3efb-4891-bf25-c32a101421f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:17.617963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccaabe-3efb-4891-bf25-c32a101421f1 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:17.627634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 707/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:19.910736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa52c92-6ca1-4108-80c6-63004f4dafbd None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:19.911314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa52c92-6ca1-4108-80c6-63004f4dafbd None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:19.912842 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa52c92-6ca1-4108-80c6-63004f4dafbd None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:19.914895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 713/1420] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:42:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:19.919994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910ed97-0e40-42b2-9271-009548de36d8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:19.920780 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910ed97-0e40-42b2-9271-009548de36d8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:19.921232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910ed97-0e40-42b2-9271-009548de36d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:19.942682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9910ed97-0e40-42b2-9271-009548de36d8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:19.944172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9910ed97-0e40-42b2-9271-009548de36d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:19.953081 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 708/1421] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:19.996699 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa52c92-6ca1-4108-80c6-63004f4dafbd None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:20.014722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa52c92-6ca1-4108-80c6-63004f4dafbd None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:20.020342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e945a8-ea26-434f-a6aa-0a49c1d43fec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:20.021986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e945a8-ea26-434f-a6aa-0a49c1d43fec service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:20.022422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e945a8-ea26-434f-a6aa-0a49c1d43fec service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:20.022842 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e945a8-ea26-434f-a6aa-0a49c1d43fec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:20.031980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e945a8-ea26-434f-a6aa-0a49c1d43fec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:20.033851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e945a8-ea26-434f-a6aa-0a49c1d43fec service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:20.043844 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 714/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:39.883602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12fc14-58d7-455d-811d-cd9a1fc9c5d0 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:39.884160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12fc14-58d7-455d-811d-cd9a1fc9c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:39.884160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12fc14-58d7-455d-811d-cd9a1fc9c5d0 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:39.885864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 709/1423] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jan 27 16:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:39.891250 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512527-e40b-484b-812e-53991270287a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:39.891717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512527-e40b-484b-812e-53991270287a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:39.891818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e512527-e40b-484b-812e-53991270287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:39.910715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-0e512527-e40b-484b-812e-53991270287a None None] MFA Rules not processed for user `6f5bbcf690d144ab99438b3f65b5e100`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:39.912091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0e512527-e40b-484b-812e-53991270287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:39.920507 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 715/1424] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jan 27 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:39.934724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88eba1-a105-4a1a-88af-9c80d491e3aa None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:39.935015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88eba1-a105-4a1a-88af-9c80d491e3aa None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:39.935293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88eba1-a105-4a1a-88af-9c80d491e3aa None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:39.937121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 710/1425] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jan 27 16:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:39.942211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9440b-c55f-48bb-94b9-643ee0d061fa None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:39.942580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9440b-c55f-48bb-94b9-643ee0d061fa None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:39.942862 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9440b-c55f-48bb-94b9-643ee0d061fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:39.961130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-36e9440b-c55f-48bb-94b9-643ee0d061fa None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:39.962318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-36e9440b-c55f-48bb-94b9-643ee0d061fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:39.971427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 716/1426] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jan 27 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:42:42.789754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cf74b-939e-4619-8eca-bb0bfd847105 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:42.790284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cf74b-939e-4619-8eca-bb0bfd847105 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:42.790284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cf74b-939e-4619-8eca-bb0bfd847105 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:42.792098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 711/1427] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:42.797462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17cc17-9869-4da8-8237-b813c40ef28d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:42.797893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17cc17-9869-4da8-8237-b813c40ef28d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:42.797998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17cc17-9869-4da8-8237-b813c40ef28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:42.815430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-5b17cc17-9869-4da8-8237-b813c40ef28d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:42.817362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5b17cc17-9869-4da8-8237-b813c40ef28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:42.825234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 717/1428] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:42.867554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cf74b-939e-4619-8eca-bb0bfd847105 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:42.882066 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cf74b-939e-4619-8eca-bb0bfd847105 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:42.887394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0fb41-7d15-4bcb-ad91-0ad6ebe123b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:42.888069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0fb41-7d15-4bcb-ad91-0ad6ebe123b8 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:42.888354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0fb41-7d15-4bcb-ad91-0ad6ebe123b8 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:42.888633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0fb41-7d15-4bcb-ad91-0ad6ebe123b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:42.897585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0fb41-7d15-4bcb-ad91-0ad6ebe123b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:42.899160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0fb41-7d15-4bcb-ad91-0ad6ebe123b8 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:42.908609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 712/1429] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:44.257502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fdd4e-6096-45be-9c10-8b20045f76ac None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:44.258072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fdd4e-6096-45be-9c10-8b20045f76ac None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:44.258072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fdd4e-6096-45be-9c10-8b20045f76ac None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:44.259891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 718/1430] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:44.265033 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b02e6-8b11-4785-9e73-95a0f4a2dc2d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:44.265460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b02e6-8b11-4785-9e73-95a0f4a2dc2d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:44.265579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b02e6-8b11-4785-9e73-95a0f4a2dc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:44.283859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b76b02e6-8b11-4785-9e73-95a0f4a2dc2d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:44.285040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b76b02e6-8b11-4785-9e73-95a0f4a2dc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:44.293212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 713/1431] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:44.447187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fdd4e-6096-45be-9c10-8b20045f76ac None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:44.462183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fdd4e-6096-45be-9c10-8b20045f76ac None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:44.467380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa0e75-7d14-442a-9de5-c89a317e1162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:44.468047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa0e75-7d14-442a-9de5-c89a317e1162 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:44.468330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa0e75-7d14-442a-9de5-c89a317e1162 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:44.468604 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa0e75-7d14-442a-9de5-c89a317e1162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:44.477083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa0e75-7d14-442a-9de5-c89a317e1162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:44.478662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa0e75-7d14-442a-9de5-c89a317e1162 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:44.487866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 719/1432] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:45.799888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2306a-9431-4805-892e-5ac8b27c2c04 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:45.800433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2306a-9431-4805-892e-5ac8b27c2c04 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:45.800433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2306a-9431-4805-892e-5ac8b27c2c04 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:45.802405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 714/1433] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:45.807333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fe76e-428f-4caa-a94b-f43be6f42508 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:45.807793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fe76e-428f-4caa-a94b-f43be6f42508 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:45.807935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fe76e-428f-4caa-a94b-f43be6f42508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:45.826028 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-eb9fe76e-428f-4caa-a94b-f43be6f42508 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:45.827211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-eb9fe76e-428f-4caa-a94b-f43be6f42508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:45.835624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 720/1434] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:45.997430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2306a-9431-4805-892e-5ac8b27c2c04 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:46.011877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2306a-9431-4805-892e-5ac8b27c2c04 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:46.017170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3fcb24-b463-42dd-8487-c68eb18d4e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:46.017798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fcb24-b463-42dd-8487-c68eb18d4e92 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:46.018081 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fcb24-b463-42dd-8487-c68eb18d4e92 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:46.018356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fcb24-b463-42dd-8487-c68eb18d4e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:46.026718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fcb24-b463-42dd-8487-c68eb18d4e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:46.028322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3fcb24-b463-42dd-8487-c68eb18d4e92 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:46.037729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 715/1435] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:47.380215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c610d2-5c2e-4fbb-8610-5452c0bc0534 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:47.380733 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c610d2-5c2e-4fbb-8610-5452c0bc0534 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:47.380733 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c610d2-5c2e-4fbb-8610-5452c0bc0534 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:47.382501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 721/1436] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:47.387437 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeef96-5240-43ea-a818-66c25782dd6f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:47.387868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeef96-5240-43ea-a818-66c25782dd6f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:47.388024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeeef96-5240-43ea-a818-66c25782dd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:47.406247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2aeeef96-5240-43ea-a818-66c25782dd6f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:47.407425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2aeeef96-5240-43ea-a818-66c25782dd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:47.415033 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 716/1437] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:42:47.569269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c610d2-5c2e-4fbb-8610-5452c0bc0534 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:47.583875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c610d2-5c2e-4fbb-8610-5452c0bc0534 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:47.589116 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e34722-9f74-4bca-855a-65623cbf8f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:47.589741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e34722-9f74-4bca-855a-65623cbf8f6d service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:47.590024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e34722-9f74-4bca-855a-65623cbf8f6d service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:47.590300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e34722-9f74-4bca-855a-65623cbf8f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:47.598292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e34722-9f74-4bca-855a-65623cbf8f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:47.599914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e34722-9f74-4bca-855a-65623cbf8f6d service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:47.608939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 722/1438] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:48.927707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d912d7-81f3-45aa-9ddb-81a23bf7f69c None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:48.928272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d912d7-81f3-45aa-9ddb-81a23bf7f69c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:48.928386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d912d7-81f3-45aa-9ddb-81a23bf7f69c None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:48.930188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 717/1439] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:48.935039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e65b9-4c71-4613-a98b-b328c38b7bc8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:48.935472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e65b9-4c71-4613-a98b-b328c38b7bc8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:48.935627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e65b9-4c71-4613-a98b-b328c38b7bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:48.953500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-098e65b9-4c71-4613-a98b-b328c38b7bc8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:48.954693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-098e65b9-4c71-4613-a98b-b328c38b7bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:48.962630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 723/1440] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:49.116858 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d912d7-81f3-45aa-9ddb-81a23bf7f69c None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:49.130964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d912d7-81f3-45aa-9ddb-81a23bf7f69c None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:49.136225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63c6ed-6e53-4b9b-803a-25c334fd501d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:49.136857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c6ed-6e53-4b9b-803a-25c334fd501d service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:49.137146 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c6ed-6e53-4b9b-803a-25c334fd501d service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:49.137425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63c6ed-6e53-4b9b-803a-25c334fd501d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:49.145444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63c6ed-6e53-4b9b-803a-25c334fd501d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:49.147019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63c6ed-6e53-4b9b-803a-25c334fd501d service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:49.156337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 718/1441] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:50.434037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bffb1-9c3b-49ed-8f2d-afac4d4862a2 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:50.434610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bffb1-9c3b-49ed-8f2d-afac4d4862a2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:50.434610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bffb1-9c3b-49ed-8f2d-afac4d4862a2 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:50.436389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 724/1442] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:50.441350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac005c-49a3-41aa-b988-961b5c41b9c8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:50.441785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac005c-49a3-41aa-b988-961b5c41b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:50.442042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bac005c-49a3-41aa-b988-961b5c41b9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:50.459865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-7bac005c-49a3-41aa-b988-961b5c41b9c8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:50.461064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7bac005c-49a3-41aa-b988-961b5c41b9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:50.469119 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 719/1443] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:50.622793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bffb1-9c3b-49ed-8f2d-afac4d4862a2 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:50.636964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bffb1-9c3b-49ed-8f2d-afac4d4862a2 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:50.642214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d193a6-3ed9-41bb-93d7-2d977c656cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:50.642840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d193a6-3ed9-41bb-93d7-2d977c656cd2 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:50.643120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d193a6-3ed9-41bb-93d7-2d977c656cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:50.643395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d193a6-3ed9-41bb-93d7-2d977c656cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:50.651551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d193a6-3ed9-41bb-93d7-2d977c656cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:50.653145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d193a6-3ed9-41bb-93d7-2d977c656cd2 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:50.663290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 725/1444] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:42:51.926366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619f9fe-cc77-4b3a-b0c7-4604c6403ea2 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:51.926905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619f9fe-cc77-4b3a-b0c7-4604c6403ea2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:51.926905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619f9fe-cc77-4b3a-b0c7-4604c6403ea2 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:51.928735 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 720/1445] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:51.933602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc7816-0889-4a79-abbe-cd221c3eeba9 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:51.934020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc7816-0889-4a79-abbe-cd221c3eeba9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:51.934192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc7816-0889-4a79-abbe-cd221c3eeba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:51.955441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-58dc7816-0889-4a79-abbe-cd221c3eeba9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:51.957275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-58dc7816-0889-4a79-abbe-cd221c3eeba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:51.965126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 726/1446] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:52.121633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619f9fe-cc77-4b3a-b0c7-4604c6403ea2 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:52.136196 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619f9fe-cc77-4b3a-b0c7-4604c6403ea2 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:52.141641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772c17f-5c26-40c7-8253-20bc8f3531f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:52.142279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772c17f-5c26-40c7-8253-20bc8f3531f9 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:52.142561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772c17f-5c26-40c7-8253-20bc8f3531f9 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:52.142840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772c17f-5c26-40c7-8253-20bc8f3531f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:52.151511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772c17f-5c26-40c7-8253-20bc8f3531f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:52.153116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772c17f-5c26-40c7-8253-20bc8f3531f9 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:52.162536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 721/1447] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:53.426151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57017-c32b-4925-893c-ba6ec02104b6 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:53.426713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57017-c32b-4925-893c-ba6ec02104b6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:53.426713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df57017-c32b-4925-893c-ba6ec02104b6 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:53.428432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 727/1448] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:53.433411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c04e6-3a3e-4eea-b5f5-c761cfc84857 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:53.433839 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c04e6-3a3e-4eea-b5f5-c761cfc84857 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:53.433967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c04e6-3a3e-4eea-b5f5-c761cfc84857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:53.452177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-5f4c04e6-3a3e-4eea-b5f5-c761cfc84857 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:53.453367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5f4c04e6-3a3e-4eea-b5f5-c761cfc84857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:53.461894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 722/1449] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:53.615723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df57017-c32b-4925-893c-ba6ec02104b6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:53.630340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df57017-c32b-4925-893c-ba6ec02104b6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:53.635715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76fb51-d256-49c2-9f67-9fd737ee747f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:53.636352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76fb51-d256-49c2-9f67-9fd737ee747f service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:53.636634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76fb51-d256-49c2-9f67-9fd737ee747f service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:53.636912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76fb51-d256-49c2-9f67-9fd737ee747f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:53.646352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76fb51-d256-49c2-9f67-9fd737ee747f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:53.648031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76fb51-d256-49c2-9f67-9fd737ee747f service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:53.657555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 728/1450] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:42:54.917290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccdfc2-84b2-4d1a-8dd2-275304894bf7 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:54.917844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccdfc2-84b2-4d1a-8dd2-275304894bf7 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:54.917844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccdfc2-84b2-4d1a-8dd2-275304894bf7 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:54.919536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 723/1451] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:54.924419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1d7b6-4084-4b17-9a19-b4b4284cd7d8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:54.924853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1d7b6-4084-4b17-9a19-b4b4284cd7d8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:54.924999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1d7b6-4084-4b17-9a19-b4b4284cd7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:54.944558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8be1d7b6-4084-4b17-9a19-b4b4284cd7d8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:54.945752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8be1d7b6-4084-4b17-9a19-b4b4284cd7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:54.953655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 729/1452] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:55.106052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccdfc2-84b2-4d1a-8dd2-275304894bf7 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:55.121138 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccdfc2-84b2-4d1a-8dd2-275304894bf7 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:55.126443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2e30b-dcda-4f32-9027-f3cde998ea5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:55.127074 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2e30b-dcda-4f32-9027-f3cde998ea5c service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:55.127359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2e30b-dcda-4f32-9027-f3cde998ea5c service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:55.127661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2e30b-dcda-4f32-9027-f3cde998ea5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:55.135958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2e30b-dcda-4f32-9027-f3cde998ea5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:55.137525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2e30b-dcda-4f32-9027-f3cde998ea5c service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:55.146775 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 724/1453] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:57.244610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fe25-d48b-4249-b43a-268ba6b3b4dd None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:57.245167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fe25-d48b-4249-b43a-268ba6b3b4dd None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:57.245167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fe25-d48b-4249-b43a-268ba6b3b4dd None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:57.246927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:57.252247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec21e9-001c-44f1-a97b-3af09d00847f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:57.252678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec21e9-001c-44f1-a97b-3af09d00847f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:57.252853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec21e9-001c-44f1-a97b-3af09d00847f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:57.271435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-5cec21e9-001c-44f1-a97b-3af09d00847f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:57.272660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5cec21e9-001c-44f1-a97b-3af09d00847f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:57.280600 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:57.318859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fe25-d48b-4249-b43a-268ba6b3b4dd None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:57.329134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fe25-d48b-4249-b43a-268ba6b3b4dd None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:57.333278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2efc1-3e40-42dc-bcfd-77cd06f59b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:57.333912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2efc1-3e40-42dc-bcfd-77cd06f59b11 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:57.334196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2efc1-3e40-42dc-bcfd-77cd06f59b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:57.334475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2efc1-3e40-42dc-bcfd-77cd06f59b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:57.343031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2efc1-3e40-42dc-bcfd-77cd06f59b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:57.344492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2efc1-3e40-42dc-bcfd-77cd06f59b11 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:57.353818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 731/1456] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:42:59.730736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131969c0-8451-4a2c-b8b4-6a4b2b832e95 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:59.731301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131969c0-8451-4a2c-b8b4-6a4b2b832e95 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:59.731301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131969c0-8451-4a2c-b8b4-6a4b2b832e95 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:59.733123 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:42:59.738539 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b4f64-8195-4b4a-a4ee-3c4cbbab3788 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:59.738947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b4f64-8195-4b4a-a4ee-3c4cbbab3788 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:59.739097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b4f64-8195-4b4a-a4ee-3c4cbbab3788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:59.756330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-040b4f64-8195-4b4a-a4ee-3c4cbbab3788 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:42:59.757505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-040b4f64-8195-4b4a-a4ee-3c4cbbab3788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:42:59.765277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:42:59.804044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131969c0-8451-4a2c-b8b4-6a4b2b832e95 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:42:59.814301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131969c0-8451-4a2c-b8b4-6a4b2b832e95 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:42:59.817793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3d0bf-adec-484f-a412-3edcf4746b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:42:59.818415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d0bf-adec-484f-a412-3edcf4746b2b service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:42:59.818692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d0bf-adec-484f-a412-3edcf4746b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:42:59.818965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3d0bf-adec-484f-a412-3edcf4746b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:42:59.827442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3d0bf-adec-484f-a412-3edcf4746b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:42:59.828901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3d0bf-adec-484f-a412-3edcf4746b2b service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:42:59.838457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 727/1459] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:02.373493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba876d-354f-4e7e-af52-35b382e9c176 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:02.374037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba876d-354f-4e7e-af52-35b382e9c176 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:02.374037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba876d-354f-4e7e-af52-35b382e9c176 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:02.375922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 733/1460] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:02.382153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765777f-e60f-471d-94ce-18ec8e00daa8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:02.382583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765777f-e60f-471d-94ce-18ec8e00daa8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:02.382695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765777f-e60f-471d-94ce-18ec8e00daa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:02.400866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-3765777f-e60f-471d-94ce-18ec8e00daa8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:02.402034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3765777f-e60f-471d-94ce-18ec8e00daa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:02.410334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 728/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:02.448255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba876d-354f-4e7e-af52-35b382e9c176 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:02.459516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba876d-354f-4e7e-af52-35b382e9c176 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:02.463109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361952df-9d27-442a-9fe8-743ff2dd60c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:02.463831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361952df-9d27-442a-9fe8-743ff2dd60c4 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:02.464103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361952df-9d27-442a-9fe8-743ff2dd60c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:02.464381 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361952df-9d27-442a-9fe8-743ff2dd60c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:02.473163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361952df-9d27-442a-9fe8-743ff2dd60c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:02.474579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361952df-9d27-442a-9fe8-743ff2dd60c4 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:02.483718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 734/1462] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:04.840873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e965c8-91f0-41d7-af97-5b03a2f1766c None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:04.841413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e965c8-91f0-41d7-af97-5b03a2f1766c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:04.841413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e965c8-91f0-41d7-af97-5b03a2f1766c None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:04.843105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:04.849167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cfb3c-db37-4077-ab17-42e5adaf4cdd None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:04.849568 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cfb3c-db37-4077-ab17-42e5adaf4cdd None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:04.849712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cfb3c-db37-4077-ab17-42e5adaf4cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:04.868666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-809cfb3c-db37-4077-ab17-42e5adaf4cdd None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:04.869841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-809cfb3c-db37-4077-ab17-42e5adaf4cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:04.877640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:04.916084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e965c8-91f0-41d7-af97-5b03a2f1766c None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:04.927255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e965c8-91f0-41d7-af97-5b03a2f1766c None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:04.930718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357a46f-bb4e-4935-955e-e9f4aa4f0137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:04.931351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a46f-bb4e-4935-955e-e9f4aa4f0137 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:04.931663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a46f-bb4e-4935-955e-e9f4aa4f0137 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:04.931947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357a46f-bb4e-4935-955e-e9f4aa4f0137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:04.940458 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357a46f-bb4e-4935-955e-e9f4aa4f0137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:04.942242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357a46f-bb4e-4935-955e-e9f4aa4f0137 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:04.951257 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 730/1465] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:07.260994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9258b4-e6c7-4a82-b205-4c1c957cac48 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:07.261580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9258b4-e6c7-4a82-b205-4c1c957cac48 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:07.261580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9258b4-e6c7-4a82-b205-4c1c957cac48 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:07.263330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:07.269156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a08347-3b92-477c-9857-50a2c9702ac8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:07.269938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a08347-3b92-477c-9857-50a2c9702ac8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:07.270241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a08347-3b92-477c-9857-50a2c9702ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:07.288473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b0a08347-3b92-477c-9857-50a2c9702ac8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:07.289645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b0a08347-3b92-477c-9857-50a2c9702ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:07.297213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:07.335044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9258b4-e6c7-4a82-b205-4c1c957cac48 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:07.345508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9258b4-e6c7-4a82-b205-4c1c957cac48 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:07.349657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd58456-c2aa-46b6-a5f7-ad6b17053d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:07.350293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58456-c2aa-46b6-a5f7-ad6b17053d87 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:07.350573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58456-c2aa-46b6-a5f7-ad6b17053d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:07.350851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd58456-c2aa-46b6-a5f7-ad6b17053d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:07.359716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd58456-c2aa-46b6-a5f7-ad6b17053d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:07.361170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd58456-c2aa-46b6-a5f7-ad6b17053d87 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:07.370660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 737/1468] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:09.671445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f58e3-9fc1-4537-9ace-dc09e5e776d0 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:09.671445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f58e3-9fc1-4537-9ace-dc09e5e776d0 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:09.671445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f58e3-9fc1-4537-9ace-dc09e5e776d0 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:09.671445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 732/1469] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:09.677377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd07dd-095c-40c0-93cb-d7cbe6e48185 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:09.677799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd07dd-095c-40c0-93cb-d7cbe6e48185 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:09.678126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd07dd-095c-40c0-93cb-d7cbe6e48185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:09.696273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-44cd07dd-095c-40c0-93cb-d7cbe6e48185 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:09.697479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-44cd07dd-095c-40c0-93cb-d7cbe6e48185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:09.705363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 738/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:43:09.744552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f58e3-9fc1-4537-9ace-dc09e5e776d0 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:09.755621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f58e3-9fc1-4537-9ace-dc09e5e776d0 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:09.759354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42313f91-6393-4623-bc39-4de3442bee40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:09.760040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313f91-6393-4623-bc39-4de3442bee40 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:09.760327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313f91-6393-4623-bc39-4de3442bee40 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:09.760606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313f91-6393-4623-bc39-4de3442bee40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:09.770353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313f91-6393-4623-bc39-4de3442bee40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:09.771919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313f91-6393-4623-bc39-4de3442bee40 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:09.781894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 733/1471] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:12.029206 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1e912-686e-4eb7-b98f-1e91ce6b5ce3 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:12.029739 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1e912-686e-4eb7-b98f-1e91ce6b5ce3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:12.029847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1e912-686e-4eb7-b98f-1e91ce6b5ce3 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:12.031828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 739/1472] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:12.037917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad80914-90ee-4535-92ba-1ba1cfe3b442 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:12.038331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad80914-90ee-4535-92ba-1ba1cfe3b442 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:12.038487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad80914-90ee-4535-92ba-1ba1cfe3b442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:12.056699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-dad80914-90ee-4535-92ba-1ba1cfe3b442 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:12.057891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-dad80914-90ee-4535-92ba-1ba1cfe3b442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:12.065658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 734/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:12.102399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1e912-686e-4eb7-b98f-1e91ce6b5ce3 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:12.116384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1e912-686e-4eb7-b98f-1e91ce6b5ce3 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:12.119859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b2060-197e-4843-a2a4-56f980cefb24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:12.120494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b2060-197e-4843-a2a4-56f980cefb24 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:12.120778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b2060-197e-4843-a2a4-56f980cefb24 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:12.121055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b2060-197e-4843-a2a4-56f980cefb24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:12.129920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b2060-197e-4843-a2a4-56f980cefb24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:12.131323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b2060-197e-4843-a2a4-56f980cefb24 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:12.140527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 740/1474] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:14.383284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c285760-df03-49e4-b80c-812bf52e1d20 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:14.383906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c285760-df03-49e4-b80c-812bf52e1d20 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:14.383906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c285760-df03-49e4-b80c-812bf52e1d20 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:14.385659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 735/1475] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:14.390943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592c55-3817-44bb-826e-34013007c1b3 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:14.391391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592c55-3817-44bb-826e-34013007c1b3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:14.391502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf592c55-3817-44bb-826e-34013007c1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:14.409878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-cf592c55-3817-44bb-826e-34013007c1b3 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:14.411053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-cf592c55-3817-44bb-826e-34013007c1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:14.418677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 741/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:43:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:43:14.455296 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c285760-df03-49e4-b80c-812bf52e1d20 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:14.466485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c285760-df03-49e4-b80c-812bf52e1d20 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:14.470020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eab328-fb61-46d6-9580-b4feb6ef5692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:14.470654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eab328-fb61-46d6-9580-b4feb6ef5692 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:14.470937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eab328-fb61-46d6-9580-b4feb6ef5692 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:14.471217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eab328-fb61-46d6-9580-b4feb6ef5692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:14.480307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eab328-fb61-46d6-9580-b4feb6ef5692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:14.481737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eab328-fb61-46d6-9580-b4feb6ef5692 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:14.490935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 736/1477] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:16.741062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43f3f-436e-4e55-aef1-09b8dd8f0fe5 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:16.741589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43f3f-436e-4e55-aef1-09b8dd8f0fe5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:16.741589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f43f3f-436e-4e55-aef1-09b8dd8f0fe5 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:16.743288 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 742/1478] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:16.748810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c14ab-11d9-418e-a787-12312808d851 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:16.749245 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c14ab-11d9-418e-a787-12312808d851 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:16.749354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c14ab-11d9-418e-a787-12312808d851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:16.766945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-107c14ab-11d9-418e-a787-12312808d851 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:16.768216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-107c14ab-11d9-418e-a787-12312808d851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:16.776663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 737/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:16.813685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f43f3f-436e-4e55-aef1-09b8dd8f0fe5 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:16.815369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d1f43f3f-436e-4e55-aef1-09b8dd8f0fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:16.828669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f43f3f-436e-4e55-aef1-09b8dd8f0fe5 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:16.832846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881427b-c69b-48b5-861f-d30417919962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:16.833482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881427b-c69b-48b5-861f-d30417919962 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:16.833769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881427b-c69b-48b5-861f-d30417919962 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:16.834051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881427b-c69b-48b5-861f-d30417919962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:16.842767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881427b-c69b-48b5-861f-d30417919962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:16.844222 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881427b-c69b-48b5-861f-d30417919962 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:16.853685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 743/1480] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:19.071847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487bef1-d0d3-454f-a07c-24109cc31d02 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:19.072385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487bef1-d0d3-454f-a07c-24109cc31d02 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:19.072385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487bef1-d0d3-454f-a07c-24109cc31d02 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:19.074185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 738/1481] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:19.079503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f18c-3da8-415d-813c-1e686f477738 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:19.079967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f18c-3da8-415d-813c-1e686f477738 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:19.080100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5f18c-3da8-415d-813c-1e686f477738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:19.098054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-6ac5f18c-3da8-415d-813c-1e686f477738 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:19.099258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6ac5f18c-3da8-415d-813c-1e686f477738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:19.106897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 744/1482] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:19.144661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487bef1-d0d3-454f-a07c-24109cc31d02 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:19.155442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487bef1-d0d3-454f-a07c-24109cc31d02 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:19.159704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470d423-7f3f-4f14-9bd2-c4ca579cae37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:19.160335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470d423-7f3f-4f14-9bd2-c4ca579cae37 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:19.160619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470d423-7f3f-4f14-9bd2-c4ca579cae37 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:19.160899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470d423-7f3f-4f14-9bd2-c4ca579cae37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:19.169441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470d423-7f3f-4f14-9bd2-c4ca579cae37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:19.170870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470d423-7f3f-4f14-9bd2-c4ca579cae37 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:19.180554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 739/1483] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:36.136463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb877ef-08ed-43c7-a5c3-76b5005c73e4 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:36.137066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb877ef-08ed-43c7-a5c3-76b5005c73e4 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:36.137066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb877ef-08ed-43c7-a5c3-76b5005c73e4 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:36.138788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 745/1484] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:36.144464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfaeed-7014-462e-b479-26e6a5fa5b8e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:36.144902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfaeed-7014-462e-b479-26e6a5fa5b8e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:36.145003 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfaeed-7014-462e-b479-26e6a5fa5b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:36.163421 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-36dfaeed-7014-462e-b479-26e6a5fa5b8e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:36.164662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-36dfaeed-7014-462e-b479-26e6a5fa5b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:36.172613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 740/1485] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:36.219267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b016ee-3843-4048-9ca3-92cd4eaf9aa0 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:36.219556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b016ee-3843-4048-9ca3-92cd4eaf9aa0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:36.219868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b016ee-3843-4048-9ca3-92cd4eaf9aa0 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:36.222123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 746/1486] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jan 27 16:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:36.226942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e051-a8ae-4191-ac78-0ef6cd17431c None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:36.227257 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e051-a8ae-4191-ac78-0ef6cd17431c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:36.227553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e051-a8ae-4191-ac78-0ef6cd17431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:36.245956 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a931e051-a8ae-4191-ac78-0ef6cd17431c None None] MFA Rules not processed for user `295fe8f61f87423bb49471e2f0085690`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:36.247151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a931e051-a8ae-4191-ac78-0ef6cd17431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:36.253800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 741/1487] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jan 27 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:36.260937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b016ee-3843-4048-9ca3-92cd4eaf9aa0 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:36.271419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b016ee-3843-4048-9ca3-92cd4eaf9aa0 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:36.274909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898c1e-9e22-4b7d-ad92-00681c0af2c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '295fe8f61f87423bb49471e2f0085690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:36.275534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898c1e-9e22-4b7d-ad92-00681c0af2c6 service glance] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:36.275848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898c1e-9e22-4b7d-ad92-00681c0af2c6 service glance] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:36.276125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898c1e-9e22-4b7d-ad92-00681c0af2c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:36.285612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898c1e-9e22-4b7d-ad92-00681c0af2c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:36.287017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898c1e-9e22-4b7d-ad92-00681c0af2c6 service glance] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:36.296122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 747/1488] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:38.606428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22cab5-f447-41f9-b1d7-430f06977e8e None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:38.607329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22cab5-f447-41f9-b1d7-430f06977e8e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:38.607329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a22cab5-f447-41f9-b1d7-430f06977e8e None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:38.608820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 742/1489] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:38.614757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb8c57-01e1-4502-b5de-84e27034697f None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:38.615211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb8c57-01e1-4502-b5de-84e27034697f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:38.615310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb8c57-01e1-4502-b5de-84e27034697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:38.633341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-cfeb8c57-01e1-4502-b5de-84e27034697f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:38.634510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-cfeb8c57-01e1-4502-b5de-84e27034697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:38.642145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 748/1490] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:43:38.666707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22cab5-f447-41f9-b1d7-430f06977e8e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:38.679774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a22cab5-f447-41f9-b1d7-430f06977e8e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:38.684198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae9982-425f-474b-9751-2947a3dde144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:38.684847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9982-425f-474b-9751-2947a3dde144 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:38.685133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9982-425f-474b-9751-2947a3dde144 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:38.685415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae9982-425f-474b-9751-2947a3dde144 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:38.686155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae9982-425f-474b-9751-2947a3dde144 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:38.688039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae9982-425f-474b-9751-2947a3dde144 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:38.701565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 743/1491] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jan 27 16:43:38 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:43:40.963814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4386-0f69-4e66-87c9-d1f5ef205535 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:40.964346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4386-0f69-4e66-87c9-d1f5ef205535 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:40.964346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe4386-0f69-4e66-87c9-d1f5ef205535 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:40.966043 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 749/1492] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:40.971342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3646bce-07c8-4551-8d68-303b12cc43dd None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:40.971968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3646bce-07c8-4551-8d68-303b12cc43dd None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:40.972088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3646bce-07c8-4551-8d68-303b12cc43dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:40.990447 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e3646bce-07c8-4551-8d68-303b12cc43dd None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:40.991663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e3646bce-07c8-4551-8d68-303b12cc43dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:40.999293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 744/1493] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:41.041747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4386-0f69-4e66-87c9-d1f5ef205535 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:41.056059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe4386-0f69-4e66-87c9-d1f5ef205535 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:41.061558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85e677-8655-4788-adf8-50229f79e9d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:41.062198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85e677-8655-4788-adf8-50229f79e9d0 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:41.062485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85e677-8655-4788-adf8-50229f79e9d0 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:41.062762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85e677-8655-4788-adf8-50229f79e9d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:41.070963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85e677-8655-4788-adf8-50229f79e9d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:41.072565 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85e677-8655-4788-adf8-50229f79e9d0 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:41.082107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 750/1494] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:43.618524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3542cb-6a4d-45ec-8f01-239854958b9d None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:43.619044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3542cb-6a4d-45ec-8f01-239854958b9d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:43.619158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3542cb-6a4d-45ec-8f01-239854958b9d None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:43.620984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 745/1495] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:43.626081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f39b4-e467-4351-a447-5d3e698e414b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:43.626505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f39b4-e467-4351-a447-5d3e698e414b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:43.626644 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f39b4-e467-4351-a447-5d3e698e414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:43.645154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-406f39b4-e467-4351-a447-5d3e698e414b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:43.646338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-406f39b4-e467-4351-a447-5d3e698e414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:43.653878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 751/1496] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:43.690574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3542cb-6a4d-45ec-8f01-239854958b9d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:43.700797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3542cb-6a4d-45ec-8f01-239854958b9d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:43.704298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236fab1-05e5-4357-bfbf-576b430f67d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:43.704926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236fab1-05e5-4357-bfbf-576b430f67d4 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:43.705210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236fab1-05e5-4357-bfbf-576b430f67d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:43.705492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236fab1-05e5-4357-bfbf-576b430f67d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:43.714636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236fab1-05e5-4357-bfbf-576b430f67d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:43.716095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236fab1-05e5-4357-bfbf-576b430f67d4 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:43.725187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 746/1497] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:46.019545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214724b-cc8a-4079-8e76-499fc76ba616 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:46.020115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214724b-cc8a-4079-8e76-499fc76ba616 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:46.020115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214724b-cc8a-4079-8e76-499fc76ba616 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:46.021880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 752/1498] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:46.027115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881105fe-5afe-4463-bf1e-736aa91dac80 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:46.027552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881105fe-5afe-4463-bf1e-736aa91dac80 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:46.027707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881105fe-5afe-4463-bf1e-736aa91dac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:46.045446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-881105fe-5afe-4463-bf1e-736aa91dac80 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:46.046639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-881105fe-5afe-4463-bf1e-736aa91dac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:46.054571 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 747/1499] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:46.093503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214724b-cc8a-4079-8e76-499fc76ba616 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:46.103959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214724b-cc8a-4079-8e76-499fc76ba616 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:46.107430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac84ec0-29e9-4b26-854a-7397148f2014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:46.108109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84ec0-29e9-4b26-854a-7397148f2014 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:46.108393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84ec0-29e9-4b26-854a-7397148f2014 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:46.108670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac84ec0-29e9-4b26-854a-7397148f2014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:46.117246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac84ec0-29e9-4b26-854a-7397148f2014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:46.118671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac84ec0-29e9-4b26-854a-7397148f2014 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:46.128291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 753/1500] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:48.495318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052b188-2266-47c4-b2e2-87b58c352cb0 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:48.495874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052b188-2266-47c4-b2e2-87b58c352cb0 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:48.496001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052b188-2266-47c4-b2e2-87b58c352cb0 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:48.497682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 748/1501] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:48.504026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edb704-02ee-46d5-bbe2-87dec62d64ba None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:48.504466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edb704-02ee-46d5-bbe2-87dec62d64ba None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:48.504605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edb704-02ee-46d5-bbe2-87dec62d64ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:48.522870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d0edb704-02ee-46d5-bbe2-87dec62d64ba None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:48.524152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d0edb704-02ee-46d5-bbe2-87dec62d64ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:48.532544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 754/1502] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:48.570140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052b188-2266-47c4-b2e2-87b58c352cb0 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:48.582653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052b188-2266-47c4-b2e2-87b58c352cb0 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:48.586987 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f87f1-896d-42ea-86fd-8e58e9cf611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:48.587857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f87f1-896d-42ea-86fd-8e58e9cf611d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:48.588161 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f87f1-896d-42ea-86fd-8e58e9cf611d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:48.588436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f87f1-896d-42ea-86fd-8e58e9cf611d admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:48.589605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f87f1-896d-42ea-86fd-8e58e9cf611d admin admin] RBAC: Authorizing `identity:get_project(project_id=0e1134f718c7471d948ccfe1ca59674e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:48.591368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f87f1-896d-42ea-86fd-8e58e9cf611d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:48.593031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 749/1503] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:43:48 2022] GET /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:43:48.604648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edb704-02ee-46d5-bbe2-87dec62d64ba None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:48.614733 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edb704-02ee-46d5-bbe2-87dec62d64ba None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:48.618307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6e9e3-03c6-4e91-86ee-d8133c0bb29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:48.618949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6e9e3-03c6-4e91-86ee-d8133c0bb29f service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:48.619232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6e9e3-03c6-4e91-86ee-d8133c0bb29f service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:48.619511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6e9e3-03c6-4e91-86ee-d8133c0bb29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:48.629876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6e9e3-03c6-4e91-86ee-d8133c0bb29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:48.631307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6e9e3-03c6-4e91-86ee-d8133c0bb29f service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:48.640555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 755/1504] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:43:51.047398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb8670-534d-4633-ab66-6e45d24569ea None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:51.048000 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb8670-534d-4633-ab66-6e45d24569ea None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:51.048100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb8670-534d-4633-ab66-6e45d24569ea None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:51.049891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 750/1505] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jan 27 16:43:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:43:51.055081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d0d4-79fe-414f-8cb7-530b6c8be53a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:51.055544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d0d4-79fe-414f-8cb7-530b6c8be53a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:51.055674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d0d4-79fe-414f-8cb7-530b6c8be53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:51.073809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b4c9d0d4-79fe-414f-8cb7-530b6c8be53a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:43:51.074986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b4c9d0d4-79fe-414f-8cb7-530b6c8be53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:43:51.083419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 756/1506] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jan 27 16:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:43:51.118576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb8670-534d-4633-ab66-6e45d24569ea None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:51.131593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb8670-534d-4633-ab66-6e45d24569ea None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:51.135968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420bfde-5165-4495-9f37-2a719741f822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:51.136810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420bfde-5165-4495-9f37-2a719741f822 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:51.137095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420bfde-5165-4495-9f37-2a719741f822 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:51.137375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420bfde-5165-4495-9f37-2a719741f822 admin admin] PATH_INFO: `/v3/projects/0e1134f718c7471d948ccfe1ca59674e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:51.138554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420bfde-5165-4495-9f37-2a719741f822 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e1134f718c7471d948ccfe1ca59674e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:51.140363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420bfde-5165-4495-9f37-2a719741f822 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:51.142017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 751/1507] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jan 27 16:43:51 2022] GET /identity/v3/projects/0e1134f718c7471d948ccfe1ca59674e => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:43:51.153916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d0d4-79fe-414f-8cb7-530b6c8be53a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:43:51.163527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d0d4-79fe-414f-8cb7-530b6c8be53a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:43:51.166977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad1a2b-bc32-44ea-b598-e9c01603ac6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:43:51.167640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad1a2b-bc32-44ea-b598-e9c01603ac6b service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:43:51.167923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad1a2b-bc32-44ea-b598-e9c01603ac6b service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:43:51.168201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad1a2b-bc32-44ea-b598-e9c01603ac6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:43:51.176824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad1a2b-bc32-44ea-b598-e9c01603ac6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:43:51.178238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad1a2b-bc32-44ea-b598-e9c01603ac6b service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:43:51.187214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 757/1508] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:45:08.974795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e73cda-7678-454f-91ba-51a81859c3e7 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:08.975352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e73cda-7678-454f-91ba-51a81859c3e7 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:08.975352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e73cda-7678-454f-91ba-51a81859c3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:08.992947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-15e73cda-7678-454f-91ba-51a81859c3e7 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:45:08.994144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-15e73cda-7678-454f-91ba-51a81859c3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:45:09.001782 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 752/1509] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:45:09.009732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eeff-a3aa-4966-8b7e-9989b8e441f6 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.010204 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eeff-a3aa-4966-8b7e-9989b8e441f6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.010301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278eeff-a3aa-4966-8b7e-9989b8e441f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.028185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-6278eeff-a3aa-4966-8b7e-9989b8e441f6 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:45:09.029362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6278eeff-a3aa-4966-8b7e-9989b8e441f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:45:09.038148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 758/1510] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:45:09.042515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e73cda-7678-454f-91ba-51a81859c3e7 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:09.051963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e73cda-7678-454f-91ba-51a81859c3e7 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:09.056363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadf2f-3c59-4d50-99be-6937b447416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:09.057008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadf2f-3c59-4d50-99be-6937b447416b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.057291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadf2f-3c59-4d50-99be-6937b447416b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.057568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadf2f-3c59-4d50-99be-6937b447416b admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.058300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beadf2f-3c59-4d50-99be-6937b447416b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:45:09.058608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beadf2f-3c59-4d50-99be-6937b447416b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:09.060308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beadf2f-3c59-4d50-99be-6937b447416b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:09.071970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 753/1511] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:45:09.080887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eeff-a3aa-4966-8b7e-9989b8e441f6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:09.089683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278eeff-a3aa-4966-8b7e-9989b8e441f6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:09.094145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8c5cc-fde0-4289-af47-ebd7e488b457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:09.094968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8c5cc-fde0-4289-af47-ebd7e488b457 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.095252 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8c5cc-fde0-4289-af47-ebd7e488b457 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.095529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8c5cc-fde0-4289-af47-ebd7e488b457 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.096275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8c5cc-fde0-4289-af47-ebd7e488b457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:09.098166 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8c5cc-fde0-4289-af47-ebd7e488b457 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:09.132482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 759/1512] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:45:09 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:45:09.136619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadf2f-3c59-4d50-99be-6937b447416b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:09.147365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadf2f-3c59-4d50-99be-6937b447416b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:09.200613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeed6b-3f6b-4fc2-8f8a-5f472475af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:09.201284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeed6b-3f6b-4fc2-8f8a-5f472475af9c admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.201571 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeed6b-3f6b-4fc2-8f8a-5f472475af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.201853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeed6b-3f6b-4fc2-8f8a-5f472475af9c admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.202571 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeed6b-3f6b-4fc2-8f8a-5f472475af9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:09.205230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeed6b-3f6b-4fc2-8f8a-5f472475af9c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:09.224521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 754/1513] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:45:09 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:45:09.228889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8c5cc-fde0-4289-af47-ebd7e488b457 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:09.239045 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8c5cc-fde0-4289-af47-ebd7e488b457 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:09.243674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a21f7-eed9-4f9e-b9ed-8426e21b60a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:09.244363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a21f7-eed9-4f9e-b9ed-8426e21b60a8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.244643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a21f7-eed9-4f9e-b9ed-8426e21b60a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.244918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a21f7-eed9-4f9e-b9ed-8426e21b60a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.245653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a21f7-eed9-4f9e-b9ed-8426e21b60a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:09.247244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714a21f7-eed9-4f9e-b9ed-8426e21b60a8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:09.261687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 760/1514] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:45:09.265736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeed6b-3f6b-4fc2-8f8a-5f472475af9c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:09.276272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeed6b-3f6b-4fc2-8f8a-5f472475af9c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:09.281008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc5c01-cd50-4c33-bf01-5d9488e23da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:09.281659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc5c01-cd50-4c33-bf01-5d9488e23da5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.281941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc5c01-cd50-4c33-bf01-5d9488e23da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.282381 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc5c01-cd50-4c33-bf01-5d9488e23da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.283121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc5c01-cd50-4c33-bf01-5d9488e23da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:09.284760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fc5c01-cd50-4c33-bf01-5d9488e23da5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:09.297657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 755/1515] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:45:09.301703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a21f7-eed9-4f9e-b9ed-8426e21b60a8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:09.311330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a21f7-eed9-4f9e-b9ed-8426e21b60a8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:09.316582 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fad848-bc5c-4ce6-b27c-7fc42c177500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:09.317433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fad848-bc5c-4ce6-b27c-7fc42c177500 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.317717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fad848-bc5c-4ce6-b27c-7fc42c177500 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.317991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fad848-bc5c-4ce6-b27c-7fc42c177500 admin admin] PATH_INFO: `/v3/projects/18c3bc3f85e647a0ae4c3e1d5ac38667/users/61b69066521946da8b81e6315ac21051/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.332561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fad848-bc5c-4ce6-b27c-7fc42c177500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c3bc3f85e647a0ae4c3e1d5ac38667, user_id=61b69066521946da8b81e6315ac21051, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:09.335215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fad848-bc5c-4ce6-b27c-7fc42c177500 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:09.348217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 761/1516] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:45:09 2022] PUT /identity/v3/projects/18c3bc3f85e647a0ae4c3e1d5ac38667/users/61b69066521946da8b81e6315ac21051/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:45:09.360062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a87db-a2b8-4725-a4e2-974fe5b6eace None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.360346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a87db-a2b8-4725-a4e2-974fe5b6eace None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.360622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a87db-a2b8-4725-a4e2-974fe5b6eace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.386108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-db2a87db-a2b8-4725-a4e2-974fe5b6eace None None] MFA Rules not processed for user `61b69066521946da8b81e6315ac21051`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:45:09.387316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-db2a87db-a2b8-4725-a4e2-974fe5b6eace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:45:09.448375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 756/1517] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:45:09.459201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fad848-bc5c-4ce6-b27c-7fc42c177500 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:09.525153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fad848-bc5c-4ce6-b27c-7fc42c177500 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:09.531052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ef2f1-da95-4611-857c-e37b3a970914 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:09.531737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ef2f1-da95-4611-857c-e37b3a970914 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.532045 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ef2f1-da95-4611-857c-e37b3a970914 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.532326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ef2f1-da95-4611-857c-e37b3a970914 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.539959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ef2f1-da95-4611-857c-e37b3a970914 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:09.541533 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ef2f1-da95-4611-857c-e37b3a970914 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:09.550667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 762/1518] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:45:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:45:09.617933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4a73-6b67-4102-93ce-e8c9f8d22d33 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.618221 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4a73-6b67-4102-93ce-e8c9f8d22d33 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.618498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b4a73-6b67-4102-93ce-e8c9f8d22d33 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.620216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 757/1519] 10.222.0.48 () {52 vars in 829 bytes} [Thu Jan 27 16:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:45:09.623848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ef2f1-da95-4611-857c-e37b3a970914 service nova] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:09.683555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ef2f1-da95-4611-857c-e37b3a970914 service nova] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:09.687946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:09.689514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.689795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.690066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] PATH_INFO: `/v3/users/61b69066521946da8b81e6315ac21051` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.691254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b69066521946da8b81e6315ac21051)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:09.692315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:45:09.692315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:45:09.692315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:45:09.693510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:09.755520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b69066521946da8b81e6315ac21051'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:09.767762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b69066521946da8b81e6315ac21051'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:09.787275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b69066521946da8b81e6315ac21051'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:09.796285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b69066521946da8b81e6315ac21051'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:09.796913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b69066521946da8b81e6315ac21051'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:09.803802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 763/1520] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:45:09 2022] DELETE /identity/v3/users/61b69066521946da8b81e6315ac21051 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:45:09.808342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0552-f937-4799-b805-3ee994e2989b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.808630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0552-f937-4799-b805-3ee994e2989b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.808908 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e0552-f937-4799-b805-3ee994e2989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.825912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a82e0552-f937-4799-b805-3ee994e2989b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:45:09.827085 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a82e0552-f937-4799-b805-3ee994e2989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:45:09.882501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 758/1521] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:45:09.892197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:09.893596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:45:09.948527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba42c8e-c031-4676-8d40-60d5db1038b8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:09.952037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0cb18-aa53-429c-b1b1-523765ddadfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:09.952678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0cb18-aa53-429c-b1b1-523765ddadfc service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:09.952960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0cb18-aa53-429c-b1b1-523765ddadfc service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:09.953235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0cb18-aa53-429c-b1b1-523765ddadfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:09.962007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0cb18-aa53-429c-b1b1-523765ddadfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:09.963430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0cb18-aa53-429c-b1b1-523765ddadfc service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:09.973308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 764/1522] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:45:10.306801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0552-f937-4799-b805-3ee994e2989b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:45:10.308019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a82e0552-f937-4799-b805-3ee994e2989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:45:10.320465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e0552-f937-4799-b805-3ee994e2989b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:45:10.325270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:45:10.326135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:45:10.326442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:45:10.326720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] PATH_INFO: `/v3/projects/18c3bc3f85e647a0ae4c3e1d5ac38667` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:45:10.327993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c3bc3f85e647a0ae4c3e1d5ac38667)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:45:10.329667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:45:10.329667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:45:10.329667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:45:10.331024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:45:10.389616 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c3bc3f85e647a0ae4c3e1d5ac38667', 'request_id': 'req-ad671058-87e8-4e99-852c-5ddcc08f48dd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:10.399584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c3bc3f85e647a0ae4c3e1d5ac38667', 'request_id': 'req-ad671058-87e8-4e99-852c-5ddcc08f48dd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:10.413472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c3bc3f85e647a0ae4c3e1d5ac38667', 'request_id': 'req-ad671058-87e8-4e99-852c-5ddcc08f48dd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:10.424276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] The token cache is being invalidate because project 18c3bc3f85e647a0ae4c3e1d5ac38667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:45:10.424579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:10.425223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ad671058-87e8-4e99-852c-5ddcc08f48dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:45:10.426853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 759/1523] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:45:10 2022] DELETE /identity/v3/projects/18c3bc3f85e647a0ae4c3e1d5ac38667 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:46:42.534820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa61ba-5eb6-438d-8cb5-13f4e732b2d1 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:42.535410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa61ba-5eb6-438d-8cb5-13f4e732b2d1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:42.535410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa61ba-5eb6-438d-8cb5-13f4e732b2d1 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:42.537193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 765/1524] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:46:42.541934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91bdbe-63a4-4d2b-9d7a-74361abb46d1 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:42.545471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91bdbe-63a4-4d2b-9d7a-74361abb46d1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:42.545863 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91bdbe-63a4-4d2b-9d7a-74361abb46d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:42.565316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-0e91bdbe-63a4-4d2b-9d7a-74361abb46d1 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:46:42.566553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0e91bdbe-63a4-4d2b-9d7a-74361abb46d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:46:42.622459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 760/1525] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:46:42.780470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa61ba-5eb6-438d-8cb5-13f4e732b2d1 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:46:42.782336 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0baa61ba-5eb6-438d-8cb5-13f4e732b2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:46:42.782474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78885c-f90f-4f31-8b36-da9368030d15 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:42.782741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78885c-f90f-4f31-8b36-da9368030d15 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:42.783067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78885c-f90f-4f31-8b36-da9368030d15 None None] PATH_INFO: `/v3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:42.784407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 761/1526] 10.222.0.24 () {54 vars in 925 bytes} [Thu Jan 27 16:46:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:46:42.816410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ceeeb-9ed3-430d-9b11-17e9db524343 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:42.816698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ceeeb-9ed3-430d-9b11-17e9db524343 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:42.816981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ceeeb-9ed3-430d-9b11-17e9db524343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:42.835127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9a6ceeeb-9ed3-430d-9b11-17e9db524343 None None] MFA Rules not processed for user `6f5bbcf690d144ab99438b3f65b5e100`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:46:42.836363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9a6ceeeb-9ed3-430d-9b11-17e9db524343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:46:42.855087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa61ba-5eb6-438d-8cb5-13f4e732b2d1 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:46:42.860791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f6d96-ad98-4c6f-824e-816e8101fbd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:46:42.861442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f6d96-ad98-4c6f-824e-816e8101fbd5 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:42.861732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f6d96-ad98-4c6f-824e-816e8101fbd5 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:42.862015 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f6d96-ad98-4c6f-824e-816e8101fbd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:42.870307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f6d96-ad98-4c6f-824e-816e8101fbd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:46:42.872034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f6d96-ad98-4c6f-824e-816e8101fbd5 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:46:42.883517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 766/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:46:42.903832 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 762/1528] 10.222.0.24 () {58 vars in 1015 bytes} [Thu Jan 27 16:46:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:46:44.183341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b92b3-8aae-435e-98a1-493ba8813692 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:44.183942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b92b3-8aae-435e-98a1-493ba8813692 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:44.183942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b92b3-8aae-435e-98a1-493ba8813692 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:44.185708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 767/1529] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:46:44.191482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efef5a-13a9-46ed-af78-ec500a7669a2 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:44.191942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efef5a-13a9-46ed-af78-ec500a7669a2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:44.192087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efef5a-13a9-46ed-af78-ec500a7669a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:44.209790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d0efef5a-13a9-46ed-af78-ec500a7669a2 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:46:44.211011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d0efef5a-13a9-46ed-af78-ec500a7669a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:46:44.219233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 763/1530] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:46:44.375451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b92b3-8aae-435e-98a1-493ba8813692 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:46:44.389517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b92b3-8aae-435e-98a1-493ba8813692 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:46:44.395059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1264c60-4393-4602-a9d0-7b0f3d6908cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:46:44.395727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1264c60-4393-4602-a9d0-7b0f3d6908cc service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:44.396011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1264c60-4393-4602-a9d0-7b0f3d6908cc service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:44.396286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1264c60-4393-4602-a9d0-7b0f3d6908cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:44.405559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1264c60-4393-4602-a9d0-7b0f3d6908cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:46:44.407128 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1264c60-4393-4602-a9d0-7b0f3d6908cc service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:46:44.416177 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 768/1531] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:46:46.661193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b553a5-3f2b-40cd-85ee-6d4ef5aa4fb8 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:46.661752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b553a5-3f2b-40cd-85ee-6d4ef5aa4fb8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:46.661855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b553a5-3f2b-40cd-85ee-6d4ef5aa4fb8 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:46.663646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 764/1532] 10.222.0.48 () {54 vars in 960 bytes} [Thu Jan 27 16:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:46:46.668802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a1fac-df89-46e8-8327-fec610facd18 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:46.669248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a1fac-df89-46e8-8327-fec610facd18 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:46.669501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a1fac-df89-46e8-8327-fec610facd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:46.690572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-c36a1fac-df89-46e8-8327-fec610facd18 None None] MFA Rules not processed for user `6f5bbcf690d144ab99438b3f65b5e100`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:46:46.691780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c36a1fac-df89-46e8-8327-fec610facd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:46:46.700219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 769/1533] 10.222.0.48 () {58 vars in 1057 bytes} [Thu Jan 27 16:46:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:46:46.708172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b553a5-3f2b-40cd-85ee-6d4ef5aa4fb8 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:46:46.721185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b553a5-3f2b-40cd-85ee-6d4ef5aa4fb8 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:46:46.726112 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca41de-4d20-40ff-91ca-b741ba7726a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5bbcf690d144ab99438b3f65b5e100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:46:46.726738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca41de-4d20-40ff-91ca-b741ba7726a8 service placement] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:46.727023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca41de-4d20-40ff-91ca-b741ba7726a8 service placement] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:46.727301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca41de-4d20-40ff-91ca-b741ba7726a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:46.735753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca41de-4d20-40ff-91ca-b741ba7726a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:46:46.737352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca41de-4d20-40ff-91ca-b741ba7726a8 service placement] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:46:46.746610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 765/1534] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:46:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:46:56.124775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eca209-3ce0-4bbc-a270-d4392c350387 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:56.125339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eca209-3ce0-4bbc-a270-d4392c350387 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:56.125451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eca209-3ce0-4bbc-a270-d4392c350387 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:56.127201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 770/1535] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:46:56.132209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35af54-71c0-4dce-a280-38c486942f05 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:56.132632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35af54-71c0-4dce-a280-38c486942f05 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:56.132772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c35af54-71c0-4dce-a280-38c486942f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:56.150454 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9c35af54-71c0-4dce-a280-38c486942f05 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:46:56.151776 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9c35af54-71c0-4dce-a280-38c486942f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:46:56.159831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 766/1536] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:46:56.319260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eca209-3ce0-4bbc-a270-d4392c350387 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:46:56.333163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eca209-3ce0-4bbc-a270-d4392c350387 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:46:56.338427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7127b13-034d-4ca7-8eee-b7fdb018aade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:46:56.339057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7127b13-034d-4ca7-8eee-b7fdb018aade service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:56.339339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7127b13-034d-4ca7-8eee-b7fdb018aade service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:56.339650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7127b13-034d-4ca7-8eee-b7fdb018aade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:56.348192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7127b13-034d-4ca7-8eee-b7fdb018aade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:46:56.349761 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7127b13-034d-4ca7-8eee-b7fdb018aade service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:46:56.359414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 771/1537] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:46:57.633046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc65bb-1a4c-4765-a60b-475e0cc00fe8 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:57.633573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc65bb-1a4c-4765-a60b-475e0cc00fe8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:57.633573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc65bb-1a4c-4765-a60b-475e0cc00fe8 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:57.635383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 767/1538] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jan 27 16:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:46:57.640757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc72e9-591e-4dd3-a565-585e8f9d2839 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:57.641187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc72e9-591e-4dd3-a565-585e8f9d2839 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:57.641307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc72e9-591e-4dd3-a565-585e8f9d2839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:57.659293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-89cc72e9-591e-4dd3-a565-585e8f9d2839 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:46:57.660506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-89cc72e9-591e-4dd3-a565-585e8f9d2839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:46:57.668059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 772/1539] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jan 27 16:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:46:57.823807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc65bb-1a4c-4765-a60b-475e0cc00fe8 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:46:57.838437 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc65bb-1a4c-4765-a60b-475e0cc00fe8 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:46:57.843889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf41074-4603-4d05-9d43-f7c9e62dfe49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:46:57.844524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41074-4603-4d05-9d43-f7c9e62dfe49 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:46:57.844814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41074-4603-4d05-9d43-f7c9e62dfe49 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:46:57.845097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf41074-4603-4d05-9d43-f7c9e62dfe49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:46:57.853057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf41074-4603-4d05-9d43-f7c9e62dfe49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:46:57.854630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf41074-4603-4d05-9d43-f7c9e62dfe49 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:46:57.863994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 768/1540] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:47:02.686502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9860c36-3ada-46a6-9b65-ab95a4d6e373 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:02.687032 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9860c36-3ada-46a6-9b65-ab95a4d6e373 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:02.687122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9860c36-3ada-46a6-9b65-ab95a4d6e373 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:02.689127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 773/1541] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:47:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:47:02.694748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa852a1-77da-43c0-8842-0731d6fabf5d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:02.696052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa852a1-77da-43c0-8842-0731d6fabf5d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:02.696340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa852a1-77da-43c0-8842-0731d6fabf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:02.715870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-aaa852a1-77da-43c0-8842-0731d6fabf5d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:47:02.717049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-aaa852a1-77da-43c0-8842-0731d6fabf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:47:02.725410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 769/1542] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:47:02.761065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9860c36-3ada-46a6-9b65-ab95a4d6e373 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:47:02.762775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c9860c36-3ada-46a6-9b65-ab95a4d6e373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:47:02.818494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9860c36-3ada-46a6-9b65-ab95a4d6e373 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:47:02.821886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3322f7e-7573-4970-b5ae-cdb51ba5f7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:47:02.822525 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3322f7e-7573-4970-b5ae-cdb51ba5f7cc service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:02.822812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3322f7e-7573-4970-b5ae-cdb51ba5f7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:02.823089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3322f7e-7573-4970-b5ae-cdb51ba5f7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:02.832462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3322f7e-7573-4970-b5ae-cdb51ba5f7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:47:02.833897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3322f7e-7573-4970-b5ae-cdb51ba5f7cc service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:47:02.843054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 774/1543] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:47:05.085091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df48d-0ff2-4124-8aa7-d1991eaf2be5 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:05.085648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df48d-0ff2-4124-8aa7-d1991eaf2be5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:05.085648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16df48d-0ff2-4124-8aa7-d1991eaf2be5 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:05.087442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 770/1544] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:47:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:47:05.092691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b7a5d-577a-4f1c-b128-29129726cdb0 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:05.093074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b7a5d-577a-4f1c-b128-29129726cdb0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:05.093237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b7a5d-577a-4f1c-b128-29129726cdb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:05.111509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-4b0b7a5d-577a-4f1c-b128-29129726cdb0 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:47:05.112703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4b0b7a5d-577a-4f1c-b128-29129726cdb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:47:05.120232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 775/1545] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:47:05.157118 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16df48d-0ff2-4124-8aa7-d1991eaf2be5 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:47:05.168283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16df48d-0ff2-4124-8aa7-d1991eaf2be5 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:47:05.171759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e184c-a079-4c72-ae7a-b6b13ad51058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:47:05.172446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e184c-a079-4c72-ae7a-b6b13ad51058 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:05.172745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e184c-a079-4c72-ae7a-b6b13ad51058 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:05.173007 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e184c-a079-4c72-ae7a-b6b13ad51058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:05.181509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e184c-a079-4c72-ae7a-b6b13ad51058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:47:05.182928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e184c-a079-4c72-ae7a-b6b13ad51058 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:47:05.192337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 771/1546] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:47:09.398374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2eb8b-aefc-40b6-b58b-b5b121e087c3 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:09.398977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2eb8b-aefc-40b6-b58b-b5b121e087c3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:09.398977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2eb8b-aefc-40b6-b58b-b5b121e087c3 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:09.400892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 776/1547] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:47:09.407785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f60a-58b4-447f-b865-0c929a428807 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:09.408213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f60a-58b4-447f-b865-0c929a428807 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:09.408348 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f60a-58b4-447f-b865-0c929a428807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:09.426355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-63e0f60a-58b4-447f-b865-0c929a428807 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:47:09.427547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-63e0f60a-58b4-447f-b865-0c929a428807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:47:09.435255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 772/1548] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:47:09.690451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2eb8b-aefc-40b6-b58b-b5b121e087c3 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:47:09.692170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0bd2eb8b-aefc-40b6-b58b-b5b121e087c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:47:09.748104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2eb8b-aefc-40b6-b58b-b5b121e087c3 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:47:09.752160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329f275-5504-41ec-82cb-adca7d746050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:47:09.752802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f275-5504-41ec-82cb-adca7d746050 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:09.753081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f275-5504-41ec-82cb-adca7d746050 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:09.753353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329f275-5504-41ec-82cb-adca7d746050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:09.761998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329f275-5504-41ec-82cb-adca7d746050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:47:09.763420 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329f275-5504-41ec-82cb-adca7d746050 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:47:09.772710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 777/1549] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:47:12.057155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff966ea-50a4-4f3d-a908-4582ab1382b6 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:12.057711 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff966ea-50a4-4f3d-a908-4582ab1382b6 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:12.057711 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff966ea-50a4-4f3d-a908-4582ab1382b6 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:12.059633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 773/1550] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jan 27 16:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:47:12.065401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8306c5-e25b-4f78-9f20-5e3f659801c8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:12.065847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8306c5-e25b-4f78-9f20-5e3f659801c8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:12.065955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8306c5-e25b-4f78-9f20-5e3f659801c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:12.084251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-9b8306c5-e25b-4f78-9f20-5e3f659801c8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:47:12.085448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9b8306c5-e25b-4f78-9f20-5e3f659801c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:47:12.093143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 778/1551] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jan 27 16:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:47:12.350303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214dd6-9d2e-4042-8770-249e488a1c3c None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:12.350505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214dd6-9d2e-4042-8770-249e488a1c3c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:12.350766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd214dd6-9d2e-4042-8770-249e488a1c3c None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:12.352584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 774/1552] 10.222.0.48 () {54 vars in 963 bytes} [Thu Jan 27 16:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:47:12.357671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b985f98-4817-4163-87f3-7e244e88fde1 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:12.357962 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b985f98-4817-4163-87f3-7e244e88fde1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:12.358242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b985f98-4817-4163-87f3-7e244e88fde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:12.377499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2b985f98-4817-4163-87f3-7e244e88fde1 None None] MFA Rules not processed for user `a62aede1113047fc80983b85ae0cbfe2`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:47:12.378973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2b985f98-4817-4163-87f3-7e244e88fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:47:12.386297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 779/1553] 10.222.0.48 () {58 vars in 1060 bytes} [Thu Jan 27 16:47:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:47:12.395009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd214dd6-9d2e-4042-8770-249e488a1c3c None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:47:12.406446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd214dd6-9d2e-4042-8770-249e488a1c3c None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:47:12.410436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177de4c1-d70b-48a8-b4d1-7620236e42fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:47:12.411068 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177de4c1-d70b-48a8-b4d1-7620236e42fc service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:47:12.411353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177de4c1-d70b-48a8-b4d1-7620236e42fc service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:47:12.411664 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177de4c1-d70b-48a8-b4d1-7620236e42fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:47:12.420430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177de4c1-d70b-48a8-b4d1-7620236e42fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:47:12.421895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177de4c1-d70b-48a8-b4d1-7620236e42fc service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:47:12.431156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 775/1554] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:37.516638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276523c1-f96b-465f-ac2d-52bb4ccdc785 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.518131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276523c1-f96b-465f-ac2d-52bb4ccdc785 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.518131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276523c1-f96b-465f-ac2d-52bb4ccdc785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.549072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-276523c1-f96b-465f-ac2d-52bb4ccdc785 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.550463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-276523c1-f96b-465f-ac2d-52bb4ccdc785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.562244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 780/1555] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.570439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ce4a-29f3-4758-b235-e1c669ea379f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.571909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ce4a-29f3-4758-b235-e1c669ea379f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.571909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0ce4a-29f3-4758-b235-e1c669ea379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.595740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1fc0ce4a-29f3-4758-b235-e1c669ea379f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.597304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1fc0ce4a-29f3-4758-b235-e1c669ea379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.610308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 776/1556] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.617695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276523c1-f96b-465f-ac2d-52bb4ccdc785 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:37.633397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276523c1-f96b-465f-ac2d-52bb4ccdc785 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:37.639999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fffe3b-9387-47c8-8430-3386a3678fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:37.640673 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fffe3b-9387-47c8-8430-3386a3678fcc admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.640954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fffe3b-9387-47c8-8430-3386a3678fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.641233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fffe3b-9387-47c8-8430-3386a3678fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.641974 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fffe3b-9387-47c8-8430-3386a3678fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:37.642281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fffe3b-9387-47c8-8430-3386a3678fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:37.644061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fffe3b-9387-47c8-8430-3386a3678fcc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:37.648130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcc59e-dbd6-4f6e-8b09-b97463f88b8d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.648771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcc59e-dbd6-4f6e-8b09-b97463f88b8d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.649567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcc59e-dbd6-4f6e-8b09-b97463f88b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.659139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 781/1557] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:37.660477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622262d-1276-48fc-92f6-10ea976b009d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.661600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622262d-1276-48fc-92f6-10ea976b009d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.661911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622262d-1276-48fc-92f6-10ea976b009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.676477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-12dcc59e-dbd6-4f6e-8b09-b97463f88b8d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.678021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-12dcc59e-dbd6-4f6e-8b09-b97463f88b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.690661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2622262d-1276-48fc-92f6-10ea976b009d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.692036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2622262d-1276-48fc-92f6-10ea976b009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.697795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 777/1558] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.699384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843987b8-b6d8-47fe-a6bc-f7be7599bcd6 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.701007 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843987b8-b6d8-47fe-a6bc-f7be7599bcd6 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.702023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843987b8-b6d8-47fe-a6bc-f7be7599bcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.710808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 782/1559] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.715459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643dc5f-e060-4fec-af80-2659a4323602 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.716993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643dc5f-e060-4fec-af80-2659a4323602 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.717484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643dc5f-e060-4fec-af80-2659a4323602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.745129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-843987b8-b6d8-47fe-a6bc-f7be7599bcd6 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.747589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-843987b8-b6d8-47fe-a6bc-f7be7599bcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.757729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-0643dc5f-e060-4fec-af80-2659a4323602 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.759922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0643dc5f-e060-4fec-af80-2659a4323602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.764288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 778/1560] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.765635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843987b8-b6d8-47fe-a6bc-f7be7599bcd6 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:37.769687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 783/1561] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.770917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902bb7f-805d-4d63-b7e5-ddd9ac866425 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.771205 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902bb7f-805d-4d63-b7e5-ddd9ac866425 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.771482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902bb7f-805d-4d63-b7e5-ddd9ac866425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.778995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843987b8-b6d8-47fe-a6bc-f7be7599bcd6 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:37.783964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414adfc-bb22-4c59-9de4-ac959b788998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:37.784617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414adfc-bb22-4c59-9de4-ac959b788998 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.784898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414adfc-bb22-4c59-9de4-ac959b788998 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.785199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414adfc-bb22-4c59-9de4-ac959b788998 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.785925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414adfc-bb22-4c59-9de4-ac959b788998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:37.787901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414adfc-bb22-4c59-9de4-ac959b788998 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:37.793021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e902bb7f-805d-4d63-b7e5-ddd9ac866425 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.795010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e902bb7f-805d-4d63-b7e5-ddd9ac866425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.803052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 784/1562] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.804392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e835c0-4283-46e5-94a8-9259c3cb4f60 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.804751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e835c0-4283-46e5-94a8-9259c3cb4f60 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.804978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e835c0-4283-46e5-94a8-9259c3cb4f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.814515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 779/1563] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:37.815780 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e206223-14de-42d1-b543-731a9ac57c9b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.816073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e206223-14de-42d1-b543-731a9ac57c9b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.816349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e206223-14de-42d1-b543-731a9ac57c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.825624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b4e835c0-4283-46e5-94a8-9259c3cb4f60 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.826828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b4e835c0-4283-46e5-94a8-9259c3cb4f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.833735 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-7e206223-14de-42d1-b543-731a9ac57c9b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.834890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7e206223-14de-42d1-b543-731a9ac57c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.886187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 785/1564] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.888532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101ab8-6478-4206-8043-21170adc3edb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.888827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101ab8-6478-4206-8043-21170adc3edb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.889109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101ab8-6478-4206-8043-21170adc3edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.897407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 780/1565] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.898951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce8d7b-0adc-46aa-b370-d2b5c0635d99 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.899305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce8d7b-0adc-46aa-b370-d2b5c0635d99 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.899627 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce8d7b-0adc-46aa-b370-d2b5c0635d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.907679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-56101ab8-6478-4206-8043-21170adc3edb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.908881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-56101ab8-6478-4206-8043-21170adc3edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.919628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 786/1566] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.919628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4a99-a0b7-4295-8833-1edad03f7791 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.919628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4a99-a0b7-4295-8833-1edad03f7791 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.919628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4a99-a0b7-4295-8833-1edad03f7791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.924731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-8bce8d7b-0adc-46aa-b370-d2b5c0635d99 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.925936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8bce8d7b-0adc-46aa-b370-d2b5c0635d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.933897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 781/1567] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.935243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33b540-6855-448c-bef0-36a87df80e84 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.935535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33b540-6855-448c-bef0-36a87df80e84 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.935847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33b540-6855-448c-bef0-36a87df80e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.940172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d26b4a99-a0b7-4295-8833-1edad03f7791 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.941619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d26b4a99-a0b7-4295-8833-1edad03f7791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.949417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 787/1568] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.950706 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b4a99-a0b7-4295-8833-1edad03f7791 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:37.957813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-4f33b540-6855-448c-bef0-36a87df80e84 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:37.958994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4f33b540-6855-448c-bef0-36a87df80e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:37.959655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b4a99-a0b7-4295-8833-1edad03f7791 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:37.964007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3d94c-32c7-4422-82e7-b1e503ec0bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:37.964640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d94c-32c7-4422-82e7-b1e503ec0bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.964922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d94c-32c7-4422-82e7-b1e503ec0bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.965210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3d94c-32c7-4422-82e7-b1e503ec0bf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.966018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3d94c-32c7-4422-82e7-b1e503ec0bf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:37.966319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3d94c-32c7-4422-82e7-b1e503ec0bf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:37.966893 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 782/1569] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:37.967666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33b540-6855-448c-bef0-36a87df80e84 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:37.967934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3d94c-32c7-4422-82e7-b1e503ec0bf8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:37.979429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33b540-6855-448c-bef0-36a87df80e84 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:37.979885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 788/1570] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:37.980719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3d94c-32c7-4422-82e7-b1e503ec0bf8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:37.984527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c592577-f3f5-4e4d-9a7d-a6227b646a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:37.985189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c592577-f3f5-4e4d-9a7d-a6227b646a52 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.985474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c592577-f3f5-4e4d-9a7d-a6227b646a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.985750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c592577-f3f5-4e4d-9a7d-a6227b646a52 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.986453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c592577-f3f5-4e4d-9a7d-a6227b646a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:37.988429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c592577-f3f5-4e4d-9a7d-a6227b646a52 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:37.991095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3d94c-32c7-4422-82e7-b1e503ec0bf8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:37.995643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c3eb-b3e3-489a-ad73-b1b49f37965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:37.996281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c3eb-b3e3-489a-ad73-b1b49f37965d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:37.997115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c3eb-b3e3-489a-ad73-b1b49f37965d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:37.997399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c3eb-b3e3-489a-ad73-b1b49f37965d admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:37.998126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8c3eb-b3e3-489a-ad73-b1b49f37965d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:37.998434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8c3eb-b3e3-489a-ad73-b1b49f37965d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.000068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8c3eb-b3e3-489a-ad73-b1b49f37965d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.010766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 783/1571] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:37 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.010766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711b9b-48aa-4995-b650-eb8bb0e3d951 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.010766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711b9b-48aa-4995-b650-eb8bb0e3d951 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.010766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db711b9b-48aa-4995-b650-eb8bb0e3d951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.012322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 789/1572] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:38.013758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabeb1e-812b-4b4e-b74f-de721d034e7a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.014049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabeb1e-812b-4b4e-b74f-de721d034e7a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.014330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adabeb1e-812b-4b4e-b74f-de721d034e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.027463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-db711b9b-48aa-4995-b650-eb8bb0e3d951 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:38.029024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-db711b9b-48aa-4995-b650-eb8bb0e3d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:38.035703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-adabeb1e-812b-4b4e-b74f-de721d034e7a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:38.036815 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 784/1573] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:38.039829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-adabeb1e-812b-4b4e-b74f-de721d034e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:38.039943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391861e-b769-471d-aa27-0b24db703cef None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.039943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391861e-b769-471d-aa27-0b24db703cef None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.039943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391861e-b769-471d-aa27-0b24db703cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.046984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 790/1574] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:38.046984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabeb1e-812b-4b4e-b74f-de721d034e7a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.056802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1391861e-b769-471d-aa27-0b24db703cef None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:38.056969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adabeb1e-812b-4b4e-b74f-de721d034e7a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.057922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1391861e-b769-471d-aa27-0b24db703cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:38.062097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc691a-356e-424f-ad07-8910b9b2301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.062741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc691a-356e-424f-ad07-8910b9b2301c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.063026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc691a-356e-424f-ad07-8910b9b2301c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.063308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc691a-356e-424f-ad07-8910b9b2301c admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.064077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc691a-356e-424f-ad07-8910b9b2301c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:38.064391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc691a-356e-424f-ad07-8910b9b2301c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.065979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc691a-356e-424f-ad07-8910b9b2301c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.066435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 785/1575] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:38.068487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391861e-b769-471d-aa27-0b24db703cef None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.077801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391861e-b769-471d-aa27-0b24db703cef None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.077961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 791/1576] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:38.079276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc691a-356e-424f-ad07-8910b9b2301c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.082936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0646e-f3f6-4a10-a993-b39b26e09202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.083824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0646e-f3f6-4a10-a993-b39b26e09202 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.084199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0646e-f3f6-4a10-a993-b39b26e09202 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.084430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0646e-f3f6-4a10-a993-b39b26e09202 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.085332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0646e-f3f6-4a10-a993-b39b26e09202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:38.085670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0646e-f3f6-4a10-a993-b39b26e09202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.087299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0646e-f3f6-4a10-a993-b39b26e09202 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.088831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc691a-356e-424f-ad07-8910b9b2301c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.093688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046cd9c-7467-45d7-8749-0a3fe96f5b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.094330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cd9c-7467-45d7-8749-0a3fe96f5b39 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.094614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cd9c-7467-45d7-8749-0a3fe96f5b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.094893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cd9c-7467-45d7-8749-0a3fe96f5b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.095613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046cd9c-7467-45d7-8749-0a3fe96f5b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.097493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046cd9c-7467-45d7-8749-0a3fe96f5b39 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.106481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 786/1577] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:38.106481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0646e-f3f6-4a10-a993-b39b26e09202 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.109515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0646e-f3f6-4a10-a993-b39b26e09202 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.114907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152055f-5287-4ad4-aa1f-45ff235a33b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.115660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152055f-5287-4ad4-aa1f-45ff235a33b6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.115952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152055f-5287-4ad4-aa1f-45ff235a33b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.116209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152055f-5287-4ad4-aa1f-45ff235a33b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.116982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152055f-5287-4ad4-aa1f-45ff235a33b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.118579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152055f-5287-4ad4-aa1f-45ff235a33b6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.129097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 792/1578] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.133231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 787/1579] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.133402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046cd9c-7467-45d7-8749-0a3fe96f5b39 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.133518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152055f-5287-4ad4-aa1f-45ff235a33b6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.144015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152055f-5287-4ad4-aa1f-45ff235a33b6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.193136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046cd9c-7467-45d7-8749-0a3fe96f5b39 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.197764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da952f8-8adc-44bf-8d73-f541f0c6ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.198433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da952f8-8adc-44bf-8d73-f541f0c6ece7 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.198706 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da952f8-8adc-44bf-8d73-f541f0c6ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.198984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da952f8-8adc-44bf-8d73-f541f0c6ece7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.199329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa537b-804b-4d35-9ffa-90edbcc467a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.199787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da952f8-8adc-44bf-8d73-f541f0c6ece7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.200348 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa537b-804b-4d35-9ffa-90edbcc467a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.200661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa537b-804b-4d35-9ffa-90edbcc467a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.200986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa537b-804b-4d35-9ffa-90edbcc467a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.201723 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa537b-804b-4d35-9ffa-90edbcc467a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:38.201826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da952f8-8adc-44bf-8d73-f541f0c6ece7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.202030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa537b-804b-4d35-9ffa-90edbcc467a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.203665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa537b-804b-4d35-9ffa-90edbcc467a9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.214929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 788/1580] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:38.216653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa537b-804b-4d35-9ffa-90edbcc467a9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.226907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa537b-804b-4d35-9ffa-90edbcc467a9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.230474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 793/1581] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.230474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da952f8-8adc-44bf-8d73-f541f0c6ece7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.283011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b62ca-17af-4a74-8e18-cb775b035840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.283704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b62ca-17af-4a74-8e18-cb775b035840 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.283993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b62ca-17af-4a74-8e18-cb775b035840 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.284275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b62ca-17af-4a74-8e18-cb775b035840 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.285035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b62ca-17af-4a74-8e18-cb775b035840 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:38.285325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b62ca-17af-4a74-8e18-cb775b035840 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.286922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b62ca-17af-4a74-8e18-cb775b035840 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.289223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da952f8-8adc-44bf-8d73-f541f0c6ece7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.294445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40cbe2-a07f-45b8-b71a-72548e9e8f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.295065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40cbe2-a07f-45b8-b71a-72548e9e8f2f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.295352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40cbe2-a07f-45b8-b71a-72548e9e8f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.295663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40cbe2-a07f-45b8-b71a-72548e9e8f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.296513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40cbe2-a07f-45b8-b71a-72548e9e8f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:38.296828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40cbe2-a07f-45b8-b71a-72548e9e8f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.298419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40cbe2-a07f-45b8-b71a-72548e9e8f2f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.300203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 789/1582] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:38.300980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b62ca-17af-4a74-8e18-cb775b035840 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.309948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 794/1583] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:38.310559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40cbe2-a07f-45b8-b71a-72548e9e8f2f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.316788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b62ca-17af-4a74-8e18-cb775b035840 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.319747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40cbe2-a07f-45b8-b71a-72548e9e8f2f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.321535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723fa3a-987f-45ca-b039-ef3aed54e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.322188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723fa3a-987f-45ca-b039-ef3aed54e488 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.322474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723fa3a-987f-45ca-b039-ef3aed54e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.322755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723fa3a-987f-45ca-b039-ef3aed54e488 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.323459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723fa3a-987f-45ca-b039-ef3aed54e488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.324241 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6ba91-1dc5-4000-bfd8-b506a3a4a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.324905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6ba91-1dc5-4000-bfd8-b506a3a4a304 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.325190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6ba91-1dc5-4000-bfd8-b506a3a4a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.325563 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6ba91-1dc5-4000-bfd8-b506a3a4a304 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.325823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723fa3a-987f-45ca-b039-ef3aed54e488 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.326290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6ba91-1dc5-4000-bfd8-b506a3a4a304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.328260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6ba91-1dc5-4000-bfd8-b506a3a4a304 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.357022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 790/1584] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.357263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 795/1585] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.357263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6ba91-1dc5-4000-bfd8-b506a3a4a304 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.358519 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723fa3a-987f-45ca-b039-ef3aed54e488 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.414367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6ba91-1dc5-4000-bfd8-b506a3a4a304 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.417384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723fa3a-987f-45ca-b039-ef3aed54e488 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.419965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b815a-491f-4b38-82b7-198cdba54c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.420679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b815a-491f-4b38-82b7-198cdba54c65 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.420968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b815a-491f-4b38-82b7-198cdba54c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.421249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b815a-491f-4b38-82b7-198cdba54c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.422006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b815a-491f-4b38-82b7-198cdba54c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.422844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb19b4-dd41-4bbf-9088-e683cc166382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.423521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb19b4-dd41-4bbf-9088-e683cc166382 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.423755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b815a-491f-4b38-82b7-198cdba54c65 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.423867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb19b4-dd41-4bbf-9088-e683cc166382 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.424109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb19b4-dd41-4bbf-9088-e683cc166382 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.424820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb19b4-dd41-4bbf-9088-e683cc166382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.426761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb19b4-dd41-4bbf-9088-e683cc166382 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.433406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 796/1586] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.434553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b815a-491f-4b38-82b7-198cdba54c65 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.445143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b815a-491f-4b38-82b7-198cdba54c65 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.447273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 791/1587] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.448107 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb19b4-dd41-4bbf-9088-e683cc166382 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.452776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f05cbf-1d04-4ba1-b957-9e89d83b89ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.453422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f05cbf-1d04-4ba1-b957-9e89d83b89ef admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.453709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f05cbf-1d04-4ba1-b957-9e89d83b89ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.453989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f05cbf-1d04-4ba1-b957-9e89d83b89ef admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.454683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f05cbf-1d04-4ba1-b957-9e89d83b89ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.456655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f05cbf-1d04-4ba1-b957-9e89d83b89ef admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.457284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb19b4-dd41-4bbf-9088-e683cc166382 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.461805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89313372-4bb6-465b-b73f-a0057a7296fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.462448 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89313372-4bb6-465b-b73f-a0057a7296fd admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.462736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89313372-4bb6-465b-b73f-a0057a7296fd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.463021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89313372-4bb6-465b-b73f-a0057a7296fd admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.463748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89313372-4bb6-465b-b73f-a0057a7296fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.466328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89313372-4bb6-465b-b73f-a0057a7296fd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.483384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 797/1588] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.489550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 792/1589] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/users => generated 289 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.489686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f05cbf-1d04-4ba1-b957-9e89d83b89ef admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.489790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89313372-4bb6-465b-b73f-a0057a7296fd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.496864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89313372-4bb6-465b-b73f-a0057a7296fd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.551773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f05cbf-1d04-4ba1-b957-9e89d83b89ef admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.554986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb47a3-0063-4353-84b8-54a37823fe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.555704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb47a3-0063-4353-84b8-54a37823fe4d admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.555989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb47a3-0063-4353-84b8-54a37823fe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.556270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb47a3-0063-4353-84b8-54a37823fe4d admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.556501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c73a2-685c-4da5-8718-2842c1421925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.556985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb47a3-0063-4353-84b8-54a37823fe4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.557162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c73a2-685c-4da5-8718-2842c1421925 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.557448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c73a2-685c-4da5-8718-2842c1421925 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.557732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c73a2-685c-4da5-8718-2842c1421925 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.558441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c73a2-685c-4da5-8718-2842c1421925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.558911 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb47a3-0063-4353-84b8-54a37823fe4d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.560696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c73a2-685c-4da5-8718-2842c1421925 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.591688 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 793/1590] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.592280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 798/1591] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.592381 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb47a3-0063-4353-84b8-54a37823fe4d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.592477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c73a2-685c-4da5-8718-2842c1421925 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.645516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb47a3-0063-4353-84b8-54a37823fe4d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.647848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c73a2-685c-4da5-8718-2842c1421925 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.651037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546a06d-cbbb-401d-98ef-3043e65c8646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.651737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546a06d-cbbb-401d-98ef-3043e65c8646 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.652015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546a06d-cbbb-401d-98ef-3043e65c8646 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.652337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546a06d-cbbb-401d-98ef-3043e65c8646 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.653346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7ae8-e725-4f9a-9f7c-e7c25e6c453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.653585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546a06d-cbbb-401d-98ef-3043e65c8646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.654180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7ae8-e725-4f9a-9f7c-e7c25e6c453d admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.654469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7ae8-e725-4f9a-9f7c-e7c25e6c453d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.654772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b7ae8-e725-4f9a-9f7c-e7c25e6c453d admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.655501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b7ae8-e725-4f9a-9f7c-e7c25e6c453d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.655625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546a06d-cbbb-401d-98ef-3043e65c8646 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.657465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5b7ae8-e725-4f9a-9f7c-e7c25e6c453d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.678819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 794/1592] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.678819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546a06d-cbbb-401d-98ef-3043e65c8646 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.679143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 799/1593] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.679143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7ae8-e725-4f9a-9f7c-e7c25e6c453d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.687522 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b7ae8-e725-4f9a-9f7c-e7c25e6c453d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.688925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546a06d-cbbb-401d-98ef-3043e65c8646 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.692085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7d13e-6063-49b4-a744-55fb86fc7e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.692734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d13e-6063-49b4-a744-55fb86fc7e5b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.693013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d13e-6063-49b4-a744-55fb86fc7e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.693287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7d13e-6063-49b4-a744-55fb86fc7e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.693532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bc4d8-4e29-4ebf-969e-027e5f0bb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.694010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7d13e-6063-49b4-a744-55fb86fc7e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.694405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc4d8-4e29-4ebf-969e-027e5f0bb0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.694687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc4d8-4e29-4ebf-969e-027e5f0bb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.694962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bc4d8-4e29-4ebf-969e-027e5f0bb0cc admin admin] PATH_INFO: `/v3/projects/8930d227a39349b8a900ed8395fb7d2b/users/fe12b69fda1e4bb0953ec32f2f8d4864/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.695638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7d13e-6063-49b4-a744-55fb86fc7e5b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.706156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 800/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.709631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bc4d8-4e29-4ebf-969e-027e5f0bb0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8930d227a39349b8a900ed8395fb7d2b, user_id=fe12b69fda1e4bb0953ec32f2f8d4864, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.710132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7d13e-6063-49b4-a744-55fb86fc7e5b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.712328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bc4d8-4e29-4ebf-969e-027e5f0bb0cc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.720936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7d13e-6063-49b4-a744-55fb86fc7e5b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.726351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 795/1595] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:38 2022] PUT /identity/v3/projects/8930d227a39349b8a900ed8395fb7d2b/users/fe12b69fda1e4bb0953ec32f2f8d4864/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:38.727147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bc4d8-4e29-4ebf-969e-027e5f0bb0cc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.776220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3dc35-3066-4c62-afee-107116d445f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.776979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3dc35-3066-4c62-afee-107116d445f8 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.777267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3dc35-3066-4c62-afee-107116d445f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.777551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db3dc35-3066-4c62-afee-107116d445f8 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.778312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3dc35-3066-4c62-afee-107116d445f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.780248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db3dc35-3066-4c62-afee-107116d445f8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.786932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bc4d8-4e29-4ebf-969e-027e5f0bb0cc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.791754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f11c83-4f7d-4542-addd-8ff9c1c4d636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.792527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f11c83-4f7d-4542-addd-8ff9c1c4d636 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.792847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f11c83-4f7d-4542-addd-8ff9c1c4d636 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.793122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f11c83-4f7d-4542-addd-8ff9c1c4d636 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.794783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f11c83-4f7d-4542-addd-8ff9c1c4d636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.796501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f11c83-4f7d-4542-addd-8ff9c1c4d636 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.800479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 801/1596] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.801280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3dc35-3066-4c62-afee-107116d445f8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.806421 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 796/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.807188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f11c83-4f7d-4542-addd-8ff9c1c4d636 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.810872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db3dc35-3066-4c62-afee-107116d445f8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.815823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ca373-20c7-488a-beae-6ad0fb3525b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.816471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ca373-20c7-488a-beae-6ad0fb3525b5 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.816598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f11c83-4f7d-4542-addd-8ff9c1c4d636 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.816756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ca373-20c7-488a-beae-6ad0fb3525b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.817052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ca373-20c7-488a-beae-6ad0fb3525b5 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.817755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ca373-20c7-488a-beae-6ad0fb3525b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.819670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ca373-20c7-488a-beae-6ad0fb3525b5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.820980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea97dd7-aca1-47f5-bc45-47b46a7959df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.821613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97dd7-aca1-47f5-bc45-47b46a7959df admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.821894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97dd7-aca1-47f5-bc45-47b46a7959df admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.822167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea97dd7-aca1-47f5-bc45-47b46a7959df admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.822847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea97dd7-aca1-47f5-bc45-47b46a7959df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.825264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea97dd7-aca1-47f5-bc45-47b46a7959df admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.841044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 802/1598] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.841853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ca373-20c7-488a-beae-6ad0fb3525b5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.846564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 797/1599] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:38.847351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea97dd7-aca1-47f5-bc45-47b46a7959df admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.854256 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ca373-20c7-488a-beae-6ad0fb3525b5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.856903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea97dd7-aca1-47f5-bc45-47b46a7959df admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.859190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8c55a-e0a3-460c-963e-5e557dbe0415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.859881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8c55a-e0a3-460c-963e-5e557dbe0415 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.860169 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8c55a-e0a3-460c-963e-5e557dbe0415 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.860450 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8c55a-e0a3-460c-963e-5e557dbe0415 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.861218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8c55a-e0a3-460c-963e-5e557dbe0415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.861418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bd980-db49-4847-871c-49fa4664c1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.862025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd980-db49-4847-871c-49fa4664c1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.862309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd980-db49-4847-871c-49fa4664c1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.862590 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bd980-db49-4847-871c-49fa4664c1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.862818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b8c55a-e0a3-460c-963e-5e557dbe0415 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.863315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bd980-db49-4847-871c-49fa4664c1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.864926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bd980-db49-4847-871c-49fa4664c1e3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.874105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 803/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.875149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8c55a-e0a3-460c-963e-5e557dbe0415 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.875626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 798/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.877786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102b875-c25d-4aad-8c5d-1247ee50f96f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.878113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102b875-c25d-4aad-8c5d-1247ee50f96f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.878484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102b875-c25d-4aad-8c5d-1247ee50f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.888367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8c55a-e0a3-460c-963e-5e557dbe0415 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.892910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a93fe-d246-4286-9474-1b8a46f5cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.893571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a93fe-d246-4286-9474-1b8a46f5cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.893856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a93fe-d246-4286-9474-1b8a46f5cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.894138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a93fe-d246-4286-9474-1b8a46f5cb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.894878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a93fe-d246-4286-9474-1b8a46f5cb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.896502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6102b875-c25d-4aad-8c5d-1247ee50f96f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:38.896619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a93fe-d246-4286-9474-1b8a46f5cb29 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.897723 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6102b875-c25d-4aad-8c5d-1247ee50f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:38.905706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 799/1602] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:38.906547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102b875-c25d-4aad-8c5d-1247ee50f96f None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.909936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 804/1603] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.909936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a93fe-d246-4286-9474-1b8a46f5cb29 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.917596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a93fe-d246-4286-9474-1b8a46f5cb29 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.920057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102b875-c25d-4aad-8c5d-1247ee50f96f None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.922801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f376d-79b3-4e9d-bdd2-82906a499d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.923456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f376d-79b3-4e9d-bdd2-82906a499d36 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.923774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f376d-79b3-4e9d-bdd2-82906a499d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.924055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f376d-79b3-4e9d-bdd2-82906a499d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.924570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a656-355a-469e-8808-cb6bbebb1ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.924790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f376d-79b3-4e9d-bdd2-82906a499d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.925279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a656-355a-469e-8808-cb6bbebb1ada admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.925559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a656-355a-469e-8808-cb6bbebb1ada admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.925835 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085a656-355a-469e-8808-cb6bbebb1ada admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.926380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f376d-79b3-4e9d-bdd2-82906a499d36 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.926557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085a656-355a-469e-8808-cb6bbebb1ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.928177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085a656-355a-469e-8808-cb6bbebb1ada admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.936495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 805/1604] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.937292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f376d-79b3-4e9d-bdd2-82906a499d36 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.940880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 800/1605] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.940880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a656-355a-469e-8808-cb6bbebb1ada admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.948430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085a656-355a-469e-8808-cb6bbebb1ada admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.948866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f376d-79b3-4e9d-bdd2-82906a499d36 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.953538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbc86e-1aff-47ef-910e-9439266a6ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.953687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf0f6-067a-49ed-b142-1e54366723bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.954175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbc86e-1aff-47ef-910e-9439266a6ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.954296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf0f6-067a-49ed-b142-1e54366723bf admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.954458 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbc86e-1aff-47ef-910e-9439266a6ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.954585 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf0f6-067a-49ed-b142-1e54366723bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.954736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbc86e-1aff-47ef-910e-9439266a6ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.954870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf0f6-067a-49ed-b142-1e54366723bf admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.955489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbc86e-1aff-47ef-910e-9439266a6ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.955672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbf0f6-067a-49ed-b142-1e54366723bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.957082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbc86e-1aff-47ef-910e-9439266a6ff2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.957321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbf0f6-067a-49ed-b142-1e54366723bf admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.967134 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 801/1606] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.967935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbc86e-1aff-47ef-910e-9439266a6ff2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.970781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 806/1607] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.970781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf0f6-067a-49ed-b142-1e54366723bf admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:38.977147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbc86e-1aff-47ef-910e-9439266a6ff2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.979829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf0f6-067a-49ed-b142-1e54366723bf admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:38.982183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff41b4-1e6d-409f-93e2-272c2fa4e88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.982820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff41b4-1e6d-409f-93e2-272c2fa4e88e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.983101 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff41b4-1e6d-409f-93e2-272c2fa4e88e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.983376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff41b4-1e6d-409f-93e2-272c2fa4e88e admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.984135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff41b4-1e6d-409f-93e2-272c2fa4e88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.985074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4928d-bab3-4f11-811c-e4ae3067e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:38.985689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff41b4-1e6d-409f-93e2-272c2fa4e88e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.985813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4928d-bab3-4f11-811c-e4ae3067e799 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:38.986006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4928d-bab3-4f11-811c-e4ae3067e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:38.986311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4928d-bab3-4f11-811c-e4ae3067e799 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:38.987053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4928d-bab3-4f11-811c-e4ae3067e799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:38.988653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff4928d-bab3-4f11-811c-e4ae3067e799 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:38.995801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 802/1608] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:38.996569 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff41b4-1e6d-409f-93e2-272c2fa4e88e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.001451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 807/1609] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:39.001451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4928d-bab3-4f11-811c-e4ae3067e799 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.001451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5ff4928d-bab3-4f11-811c-e4ae3067e799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:39.006186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff41b4-1e6d-409f-93e2-272c2fa4e88e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.010673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e96c6-4866-4d14-9e33-7384b773c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.011534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e96c6-4866-4d14-9e33-7384b773c15d admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.011844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e96c6-4866-4d14-9e33-7384b773c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.012125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e96c6-4866-4d14-9e33-7384b773c15d admin admin] PATH_INFO: `/v3/projects/7ffef7f348f141d69256d35c3c174bf3/users/dc4bb4030c8c4e93acbe3b826a5226b4/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.026355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e96c6-4866-4d14-9e33-7384b773c15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ffef7f348f141d69256d35c3c174bf3, user_id=dc4bb4030c8c4e93acbe3b826a5226b4, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.029921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e96c6-4866-4d14-9e33-7384b773c15d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.044236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 803/1610] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:38 2022] PUT /identity/v3/projects/7ffef7f348f141d69256d35c3c174bf3/users/dc4bb4030c8c4e93acbe3b826a5226b4/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:39.063868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e96c6-4866-4d14-9e33-7384b773c15d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.064002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4928d-bab3-4f11-811c-e4ae3067e799 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.109565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e96c6-4866-4d14-9e33-7384b773c15d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.109816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071ee2-2f98-48ae-8aea-f6a2e27bbe88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.110233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071ee2-2f98-48ae-8aea-f6a2e27bbe88 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.110518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071ee2-2f98-48ae-8aea-f6a2e27bbe88 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.110798 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071ee2-2f98-48ae-8aea-f6a2e27bbe88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.114179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f7762-dc8c-44d3-bc1a-2fb53538ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.115052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7762-dc8c-44d3-bc1a-2fb53538ad74 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.115332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7762-dc8c-44d3-bc1a-2fb53538ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.115640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f7762-dc8c-44d3-bc1a-2fb53538ad74 admin admin] PATH_INFO: `/v3/projects/accb650bdbfa4de4a4129fd473ca736d/users/20137a83d3de4dcfaba05ab93c470829/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.120081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d071ee2-2f98-48ae-8aea-f6a2e27bbe88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.121594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d071ee2-2f98-48ae-8aea-f6a2e27bbe88 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.130449 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f7762-dc8c-44d3-bc1a-2fb53538ad74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accb650bdbfa4de4a4129fd473ca736d, user_id=20137a83d3de4dcfaba05ab93c470829, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.131199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 808/1611] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:39.132023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071ee2-2f98-48ae-8aea-f6a2e27bbe88 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.133329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f7762-dc8c-44d3-bc1a-2fb53538ad74 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.141902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071ee2-2f98-48ae-8aea-f6a2e27bbe88 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.150583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 804/1612] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:39 2022] PUT /identity/v3/projects/accb650bdbfa4de4a4129fd473ca736d/users/20137a83d3de4dcfaba05ab93c470829/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:39.156356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f7762-dc8c-44d3-bc1a-2fb53538ad74 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.208328 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5c3a-f466-47e0-85ef-e561de4a49f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.209277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5c3a-f466-47e0-85ef-e561de4a49f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.209728 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5c3a-f466-47e0-85ef-e561de4a49f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.210010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b5c3a-f466-47e0-85ef-e561de4a49f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.210806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b5c3a-f466-47e0-85ef-e561de4a49f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.212445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b5c3a-f466-47e0-85ef-e561de4a49f5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.223753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f7762-dc8c-44d3-bc1a-2fb53538ad74 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.224467 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 809/1613] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:39.225899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5c3a-f466-47e0-85ef-e561de4a49f5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.232965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1310b8-d608-4fbb-a621-de22ad0736c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.233648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1310b8-d608-4fbb-a621-de22ad0736c2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.233982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1310b8-d608-4fbb-a621-de22ad0736c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.234262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1310b8-d608-4fbb-a621-de22ad0736c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.235054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1310b8-d608-4fbb-a621-de22ad0736c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.236704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1310b8-d608-4fbb-a621-de22ad0736c2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.237149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b5c3a-f466-47e0-85ef-e561de4a49f5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.242801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407e105-a109-4890-bac3-8b3326bb927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.243611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407e105-a109-4890-bac3-8b3326bb927c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.243905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407e105-a109-4890-bac3-8b3326bb927c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.244106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407e105-a109-4890-bac3-8b3326bb927c admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.244860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407e105-a109-4890-bac3-8b3326bb927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.246950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407e105-a109-4890-bac3-8b3326bb927c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.247468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 805/1614] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:39.248330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1310b8-d608-4fbb-a621-de22ad0736c2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.261980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 810/1615] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:39.262838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1310b8-d608-4fbb-a621-de22ad0736c2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.262972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407e105-a109-4890-bac3-8b3326bb927c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.268061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a0b2f-d8a1-468f-a485-e72da8c29916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.269079 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a0b2f-d8a1-468f-a485-e72da8c29916 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.269431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a0b2f-d8a1-468f-a485-e72da8c29916 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.269828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a0b2f-d8a1-468f-a485-e72da8c29916 admin admin] PATH_INFO: `/v3/projects/326cd822c847423ba2417f593ca8c6ff/users/c2c8a269081c42abae453a5be4772d50/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.273319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407e105-a109-4890-bac3-8b3326bb927c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.278059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa85b2-ff22-4f8f-97e9-5f1498e1c7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.278993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa85b2-ff22-4f8f-97e9-5f1498e1c7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.279298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa85b2-ff22-4f8f-97e9-5f1498e1c7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.279594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa85b2-ff22-4f8f-97e9-5f1498e1c7cb admin admin] PATH_INFO: `/v3/projects/52b9c1434f884b9d9253c9bb1bd33340/users/9d06d4594164459da44b5a1f17b08498/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.286612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a0b2f-d8a1-468f-a485-e72da8c29916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=326cd822c847423ba2417f593ca8c6ff, user_id=c2c8a269081c42abae453a5be4772d50, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.289320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a0b2f-d8a1-468f-a485-e72da8c29916 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.295489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa85b2-ff22-4f8f-97e9-5f1498e1c7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b9c1434f884b9d9253c9bb1bd33340, user_id=9d06d4594164459da44b5a1f17b08498, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.298183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa85b2-ff22-4f8f-97e9-5f1498e1c7cb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.304048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 806/1616] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:39 2022] PUT /identity/v3/projects/326cd822c847423ba2417f593ca8c6ff/users/c2c8a269081c42abae453a5be4772d50/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:39.305371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137703c-65ff-4c56-b2da-c2fdaff6cc47 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.305666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137703c-65ff-4c56-b2da-c2fdaff6cc47 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.305942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137703c-65ff-4c56-b2da-c2fdaff6cc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.316745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 811/1617] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:39 2022] PUT /identity/v3/projects/52b9c1434f884b9d9253c9bb1bd33340/users/9d06d4594164459da44b5a1f17b08498/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:39.318203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf5aaa-39d6-4f58-87b9-833feb0e419b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.318591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf5aaa-39d6-4f58-87b9-833feb0e419b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.318967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf5aaa-39d6-4f58-87b9-833feb0e419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.341132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-5daf5aaa-39d6-4f58-87b9-833feb0e419b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:39.342870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5daf5aaa-39d6-4f58-87b9-833feb0e419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:39.346848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d137703c-65ff-4c56-b2da-c2fdaff6cc47 None None] MFA Rules not processed for user `dc4bb4030c8c4e93acbe3b826a5226b4`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:39.347962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d137703c-65ff-4c56-b2da-c2fdaff6cc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:39.416910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 812/1618] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:39.421727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf5aaa-39d6-4f58-87b9-833feb0e419b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.431582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 807/1619] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:39.431892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf5aaa-39d6-4f58-87b9-833feb0e419b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.432455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137703c-65ff-4c56-b2da-c2fdaff6cc47 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.437859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8cae-2de4-40c3-8e4d-4d01c6e5bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.438749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8cae-2de4-40c3-8e4d-4d01c6e5bea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.439037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8cae-2de4-40c3-8e4d-4d01c6e5bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.439315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c8cae-2de4-40c3-8e4d-4d01c6e5bea9 admin admin] PATH_INFO: `/v3/projects/11d012d792424a858b876a618c79f7af/users/dd2a59a36a2e422795e977c7af5004e6/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.445078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137703c-65ff-4c56-b2da-c2fdaff6cc47 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.449973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671fe35d-4ff0-42f1-9615-f02ab26b64f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.450930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe35d-4ff0-42f1-9615-f02ab26b64f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.451269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe35d-4ff0-42f1-9615-f02ab26b64f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.451490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671fe35d-4ff0-42f1-9615-f02ab26b64f4 admin admin] PATH_INFO: `/v3/projects/598ee83f7e1a494c8b94f241ab626b65/users/3cfe4a71879849b581eb8b48b24107fd/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.457471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c8cae-2de4-40c3-8e4d-4d01c6e5bea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d012d792424a858b876a618c79f7af, user_id=dd2a59a36a2e422795e977c7af5004e6, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.464449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c8cae-2de4-40c3-8e4d-4d01c6e5bea9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.469451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fe35d-4ff0-42f1-9615-f02ab26b64f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598ee83f7e1a494c8b94f241ab626b65, user_id=3cfe4a71879849b581eb8b48b24107fd, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.472286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671fe35d-4ff0-42f1-9615-f02ab26b64f4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.488642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 813/1620] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:39 2022] PUT /identity/v3/projects/11d012d792424a858b876a618c79f7af/users/dd2a59a36a2e422795e977c7af5004e6/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:39.489464 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8cae-2de4-40c3-8e4d-4d01c6e5bea9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.490548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 808/1621] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:39 2022] PUT /identity/v3/projects/598ee83f7e1a494c8b94f241ab626b65/users/3cfe4a71879849b581eb8b48b24107fd/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:39.499989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329ca5c-da0b-49ab-98bf-008b659508df None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.500494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329ca5c-da0b-49ab-98bf-008b659508df None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.500846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329ca5c-da0b-49ab-98bf-008b659508df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.520691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-f329ca5c-da0b-49ab-98bf-008b659508df None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:39.522038 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f329ca5c-da0b-49ab-98bf-008b659508df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:39.567356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c8cae-2de4-40c3-8e4d-4d01c6e5bea9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.587463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 809/1622] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:39.589495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fdb7e-f2cf-4bff-bfa3-1b84c1e4c666 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.589852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fdb7e-f2cf-4bff-bfa3-1b84c1e4c666 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.590272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fdb7e-f2cf-4bff-bfa3-1b84c1e4c666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.621077 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-951fdb7e-f2cf-4bff-bfa3-1b84c1e4c666 None None] MFA Rules not processed for user `9d06d4594164459da44b5a1f17b08498`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:39.622704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-951fdb7e-f2cf-4bff-bfa3-1b84c1e4c666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:39.639735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f77711-9c8b-45a8-a97f-9d6844d75c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.640669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f77711-9c8b-45a8-a97f-9d6844d75c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.640948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f77711-9c8b-45a8-a97f-9d6844d75c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.641225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f77711-9c8b-45a8-a97f-9d6844d75c78 admin admin] PATH_INFO: `/v3/projects/ff1a8d4f9ee74f18bc46f2412818ad0d/users/8dabc55230a9416f869637f55c70b0eb/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.658362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f77711-9c8b-45a8-a97f-9d6844d75c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1a8d4f9ee74f18bc46f2412818ad0d, user_id=8dabc55230a9416f869637f55c70b0eb, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.661493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f77711-9c8b-45a8-a97f-9d6844d75c78 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.677300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 814/1623] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:39 2022] PUT /identity/v3/projects/ff1a8d4f9ee74f18bc46f2412818ad0d/users/8dabc55230a9416f869637f55c70b0eb/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:39.678173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f77711-9c8b-45a8-a97f-9d6844d75c78 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.711147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 810/1624] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:39.713849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d247bf-d3f7-4269-9933-75e9dbb9f347 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.714861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d247bf-d3f7-4269-9933-75e9dbb9f347 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.715903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d247bf-d3f7-4269-9933-75e9dbb9f347 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.723959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 811/1625] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jan 27 16:48:39 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:48:39.726291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f2e1-a4c9-4049-bcb5-1d476e3eda27 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.726944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f2e1-a4c9-4049-bcb5-1d476e3eda27 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.727665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f2e1-a4c9-4049-bcb5-1d476e3eda27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.751031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-5a91f2e1-a4c9-4049-bcb5-1d476e3eda27 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:39.752307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5a91f2e1-a4c9-4049-bcb5-1d476e3eda27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:39.760281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f77711-9c8b-45a8-a97f-9d6844d75c78 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.766619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e95c1-7eb3-4bd8-a051-d4cd03b04815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.767601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e95c1-7eb3-4bd8-a051-d4cd03b04815 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.767716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e95c1-7eb3-4bd8-a051-d4cd03b04815 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.767969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e95c1-7eb3-4bd8-a051-d4cd03b04815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.823522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 812/1626] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:39.826178 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf8b3c-a820-4743-b5d9-c18abfee920f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.826467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf8b3c-a820-4743-b5d9-c18abfee920f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.826754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf8b3c-a820-4743-b5d9-c18abfee920f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.836771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e95c1-7eb3-4bd8-a051-d4cd03b04815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.838225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e95c1-7eb3-4bd8-a051-d4cd03b04815 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.846635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-84cf8b3c-a820-4743-b5d9-c18abfee920f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:39.848228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-84cf8b3c-a820-4743-b5d9-c18abfee920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:39.851007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 815/1627] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:39.851854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e95c1-7eb3-4bd8-a051-d4cd03b04815 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.857887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 813/1628] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:39.861619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e95c1-7eb3-4bd8-a051-d4cd03b04815 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.861906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf8b3c-a820-4743-b5d9-c18abfee920f None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:39.868897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a955279-efac-4afc-a7df-27d92766c1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.869265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955279-efac-4afc-a7df-27d92766c1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.869623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955279-efac-4afc-a7df-27d92766c1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.869972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a955279-efac-4afc-a7df-27d92766c1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.884668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a955279-efac-4afc-a7df-27d92766c1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:39.886665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a955279-efac-4afc-a7df-27d92766c1d6 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:39.903675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 816/1629] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:39.905513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59f19-0c5e-4240-90a1-62437ce6a9ca None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.905513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59f19-0c5e-4240-90a1-62437ce6a9ca None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.905801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a59f19-0c5e-4240-90a1-62437ce6a9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:39.934441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-48a59f19-0c5e-4240-90a1-62437ce6a9ca None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:39.936096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-48a59f19-0c5e-4240-90a1-62437ce6a9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:39.936999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf8b3c-a820-4743-b5d9-c18abfee920f None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:39.941667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493fb1f-5550-49ba-b581-dec0d00a6895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:39.943396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493fb1f-5550-49ba-b581-dec0d00a6895 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:39.944074 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493fb1f-5550-49ba-b581-dec0d00a6895 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:39.944605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493fb1f-5550-49ba-b581-dec0d00a6895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.044964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493fb1f-5550-49ba-b581-dec0d00a6895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:40.046866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493fb1f-5550-49ba-b581-dec0d00a6895 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:40.063524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 814/1630] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:40.065195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc22e88-6eb6-45e3-a78e-d22650407eae None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.066064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc22e88-6eb6-45e3-a78e-d22650407eae None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.066354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc22e88-6eb6-45e3-a78e-d22650407eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.096609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 817/1631] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jan 27 16:48:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:40.097630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a59f19-0c5e-4240-90a1-62437ce6a9ca None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:40.120926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1dc22e88-6eb6-45e3-a78e-d22650407eae None None] MFA Rules not processed for user `8dabc55230a9416f869637f55c70b0eb`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:40.122270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1dc22e88-6eb6-45e3-a78e-d22650407eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:40.123993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a59f19-0c5e-4240-90a1-62437ce6a9ca None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:40.130096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af3eec-1124-4f43-b015-8f9ab4f1b7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:40.131131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af3eec-1124-4f43-b015-8f9ab4f1b7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.131789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af3eec-1124-4f43-b015-8f9ab4f1b7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.131929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af3eec-1124-4f43-b015-8f9ab4f1b7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.150189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af3eec-1124-4f43-b015-8f9ab4f1b7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:40.153357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af3eec-1124-4f43-b015-8f9ab4f1b7f5 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:40.193987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 818/1632] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:40.195676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af3eec-1124-4f43-b015-8f9ab4f1b7f5 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:40.217041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af3eec-1124-4f43-b015-8f9ab4f1b7f5 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:40.221304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943137d7-be8b-4b54-95f2-c58cd77bcfc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:40.221793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943137d7-be8b-4b54-95f2-c58cd77bcfc5 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.222177 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943137d7-be8b-4b54-95f2-c58cd77bcfc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.222548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943137d7-be8b-4b54-95f2-c58cd77bcfc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.236155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943137d7-be8b-4b54-95f2-c58cd77bcfc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:40.237772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943137d7-be8b-4b54-95f2-c58cd77bcfc5 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:40.253422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 819/1633] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:40.255267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb688a3-b0a3-48f4-aa92-7e5efd91777d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.255692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb688a3-b0a3-48f4-aa92-7e5efd91777d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.256204 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb688a3-b0a3-48f4-aa92-7e5efd91777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.272554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 815/1634] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:40.273501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc22e88-6eb6-45e3-a78e-d22650407eae None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:40.301668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc22e88-6eb6-45e3-a78e-d22650407eae None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:40.311541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-4eb688a3-b0a3-48f4-aa92-7e5efd91777d None None] MFA Rules not processed for user `fe12b69fda1e4bb0953ec32f2f8d4864`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:40.313228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4eb688a3-b0a3-48f4-aa92-7e5efd91777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:40.314041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bd9af-4e48-41cb-b67f-27a951b93a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:40.316052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bd9af-4e48-41cb-b67f-27a951b93a50 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.317915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bd9af-4e48-41cb-b67f-27a951b93a50 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.318478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bd9af-4e48-41cb-b67f-27a951b93a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.415875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 820/1635] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:40.433682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8783ce9-f5a3-495f-a972-8bdf11d879fd None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.434360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8783ce9-f5a3-495f-a972-8bdf11d879fd None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.434819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8783ce9-f5a3-495f-a972-8bdf11d879fd None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.446334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 821/1636] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jan 27 16:48:40 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:48:40.449337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1bb95-3451-47c3-92e9-76d5b010f13f None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.449966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1bb95-3451-47c3-92e9-76d5b010f13f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.450896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1bb95-3451-47c3-92e9-76d5b010f13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.480509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bd9af-4e48-41cb-b67f-27a951b93a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:40.482609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bd9af-4e48-41cb-b67f-27a951b93a50 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:40.489223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7fb1bb95-3451-47c3-92e9-76d5b010f13f None None] MFA Rules not processed for user `fe12b69fda1e4bb0953ec32f2f8d4864`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:40.492746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7fb1bb95-3451-47c3-92e9-76d5b010f13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:40.505363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 816/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:40.508778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce5ee-3941-4189-8ddb-3f3e2afb05d3 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.509743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce5ee-3941-4189-8ddb-3f3e2afb05d3 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.514621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 822/1638] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:40.515057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce5ee-3941-4189-8ddb-3f3e2afb05d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.539808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2b5ce5ee-3941-4189-8ddb-3f3e2afb05d3 None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:40.541287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2b5ce5ee-3941-4189-8ddb-3f3e2afb05d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:40.569695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1bb95-3451-47c3-92e9-76d5b010f13f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:40.580783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 817/1639] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jan 27 16:48:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:40.587443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1bb95-3451-47c3-92e9-76d5b010f13f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:40.595818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f13384-2514-4149-89c9-8e856960caf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:40.596847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f13384-2514-4149-89c9-8e856960caf2 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.597344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f13384-2514-4149-89c9-8e856960caf2 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.597725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f13384-2514-4149-89c9-8e856960caf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:40.609136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f13384-2514-4149-89c9-8e856960caf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:40.611440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f13384-2514-4149-89c9-8e856960caf2 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:40.639148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 823/1640] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:40.930730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce5ee-3941-4189-8ddb-3f3e2afb05d3 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:40.953907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce5ee-3941-4189-8ddb-3f3e2afb05d3 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:40.966534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5b95-bc05-4955-b066-64bad049447a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:40.969137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5b95-bc05-4955-b066-64bad049447a service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:40.969599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5b95-bc05-4955-b066-64bad049447a service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:40.970260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5b95-bc05-4955-b066-64bad049447a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:41.002362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5b95-bc05-4955-b066-64bad049447a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:41.005554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83781c5d-4c94-4334-ac4b-22410d785b03 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:41.006756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83781c5d-4c94-4334-ac4b-22410d785b03 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:41.007012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83781c5d-4c94-4334-ac4b-22410d785b03 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:41.009383 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 824/1641] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jan 27 16:48:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:48:41.014595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5b95-bc05-4955-b066-64bad049447a service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:41.016424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4126a8-1814-43e9-ab55-7e98560677ed None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:41.016795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4126a8-1814-43e9-ab55-7e98560677ed None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:41.017434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4126a8-1814-43e9-ab55-7e98560677ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:41.050232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 818/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:41.069590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7c4126a8-1814-43e9-ab55-7e98560677ed None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:41.075074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7c4126a8-1814-43e9-ab55-7e98560677ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:41.117888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 825/1643] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:41.131230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5b95-bc05-4955-b066-64bad049447a service nova] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:41.146432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5b95-bc05-4955-b066-64bad049447a service nova] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:41.159136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe58c6-5f7a-4864-b9ce-ad42740df33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:41.161965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe58c6-5f7a-4864-b9ce-ad42740df33b service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:41.162444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe58c6-5f7a-4864-b9ce-ad42740df33b service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:41.162864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe58c6-5f7a-4864-b9ce-ad42740df33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:41.205696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6db2c-92d4-40f0-a5f9-94241153cf2f None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:41.206333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6db2c-92d4-40f0-a5f9-94241153cf2f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:41.206653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6db2c-92d4-40f0-a5f9-94241153cf2f None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:41.208720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 826/1644] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jan 27 16:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:48:41.214225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aca49-b1ea-4574-b834-76e55b9fbd4d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:41.215609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aca49-b1ea-4574-b834-76e55b9fbd4d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:41.215609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aca49-b1ea-4574-b834-76e55b9fbd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:41.225875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe58c6-5f7a-4864-b9ce-ad42740df33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:41.228514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe58c6-5f7a-4864-b9ce-ad42740df33b service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:41.248367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d35aca49-b1ea-4574-b834-76e55b9fbd4d None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:41.250302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d35aca49-b1ea-4574-b834-76e55b9fbd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:41.264669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 819/1645] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:41.267876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 827/1646] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:48:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:48:41.286405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe58c6-5f7a-4864-b9ce-ad42740df33b service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:41.288029 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e7fe58c6-5f7a-4864-b9ce-ad42740df33b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:41.416851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe58c6-5f7a-4864-b9ce-ad42740df33b service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:41.431674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4e794-4940-4a83-94d5-4847f9d31b66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '295fe8f61f87423bb49471e2f0085690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:41.432347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4e794-4940-4a83-94d5-4847f9d31b66 service glance] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:41.432631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4e794-4940-4a83-94d5-4847f9d31b66 service glance] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:41.432915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4e794-4940-4a83-94d5-4847f9d31b66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:41.458133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4e794-4940-4a83-94d5-4847f9d31b66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:41.461015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4e794-4940-4a83-94d5-4847f9d31b66 service glance] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:41.493457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 820/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:42.077184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35aca49-b1ea-4574-b834-76e55b9fbd4d None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:42.088997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35aca49-b1ea-4574-b834-76e55b9fbd4d None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:42.094895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:42.095976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:42.096360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:42.096736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] PATH_INFO: `/v3/users/dc4bb4030c8c4e93acbe3b826a5226b4` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:42.098339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4bb4030c8c4e93acbe3b826a5226b4)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:42.100677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:42.176166 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4bb4030c8c4e93acbe3b826a5226b4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:42.192243 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4bb4030c8c4e93acbe3b826a5226b4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:42.207358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4bb4030c8c4e93acbe3b826a5226b4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:42.226850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4bb4030c8c4e93acbe3b826a5226b4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:42.228209 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7bca5a73-8188-4ad7-a19e-9dd936f7a5e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4bb4030c8c4e93acbe3b826a5226b4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:42.241435 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 828/1648] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:48:42 2022] DELETE /identity/v3/users/dc4bb4030c8c4e93acbe3b826a5226b4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:42.245356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6faf81-5a91-4c23-8cd3-72f1124f36cb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:42.248640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6faf81-5a91-4c23-8cd3-72f1124f36cb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:42.249106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6faf81-5a91-4c23-8cd3-72f1124f36cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:42.274059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-de6faf81-5a91-4c23-8cd3-72f1124f36cb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:42.275441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-de6faf81-5a91-4c23-8cd3-72f1124f36cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:42.368082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 821/1649] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:42.404165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aa60a-c696-47f5-b217-849765040972 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:42.404506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aa60a-c696-47f5-b217-849765040972 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:42.405009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893aa60a-c696-47f5-b217-849765040972 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:42.407089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 829/1650] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jan 27 16:48:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:48:42.409933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6faf81-5a91-4c23-8cd3-72f1124f36cb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:42.412841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-de6faf81-5a91-4c23-8cd3-72f1124f36cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:42.426485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153c96f-bb9e-4c01-98de-8d5520aa3fc6 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:42.427006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153c96f-bb9e-4c01-98de-8d5520aa3fc6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:42.427788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153c96f-bb9e-4c01-98de-8d5520aa3fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:42.520271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-f153c96f-bb9e-4c01-98de-8d5520aa3fc6 None None] MFA Rules not processed for user `15ae418635734639a4d10676978e82cf`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:42.523335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f153c96f-bb9e-4c01-98de-8d5520aa3fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:42.589194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6faf81-5a91-4c23-8cd3-72f1124f36cb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:42.604709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a9355-47d3-4c29-a548-0fe4d525eea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:42.606448 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9355-47d3-4c29-a548-0fe4d525eea9 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:42.607338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9355-47d3-4c29-a548-0fe4d525eea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:42.607660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9355-47d3-4c29-a548-0fe4d525eea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:42.647725 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a9355-47d3-4c29-a548-0fe4d525eea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:42.649185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a9355-47d3-4c29-a548-0fe4d525eea9 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:42.670429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 822/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:42.671786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a597-e3b6-413d-b674-b2feb7df0e53 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:42.672076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a597-e3b6-413d-b674-b2feb7df0e53 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:42.672355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a597-e3b6-413d-b674-b2feb7df0e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:42.735364 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 830/1652] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:48:42.776923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b106a597-e3b6-413d-b674-b2feb7df0e53 None None] MFA Rules not processed for user `3cfe4a71879849b581eb8b48b24107fd`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:42.781354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b106a597-e3b6-413d-b674-b2feb7df0e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:42.815359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153c96f-bb9e-4c01-98de-8d5520aa3fc6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:42.826584 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153c96f-bb9e-4c01-98de-8d5520aa3fc6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:42.835711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e902fda-42bb-46d9-8c90-464a6c2a5e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:42.836491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902fda-42bb-46d9-8c90-464a6c2a5e4c service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:42.836657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902fda-42bb-46d9-8c90-464a6c2a5e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:42.836941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902fda-42bb-46d9-8c90-464a6c2a5e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:42.873442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 823/1653] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:42.879943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e902fda-42bb-46d9-8c90-464a6c2a5e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:42.881398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e902fda-42bb-46d9-8c90-464a6c2a5e4c service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:42.886062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133afdbb-6a1f-4630-bbba-80b90fbffb81 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:42.886278 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133afdbb-6a1f-4630-bbba-80b90fbffb81 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:42.886678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133afdbb-6a1f-4630-bbba-80b90fbffb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:42.912275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-133afdbb-6a1f-4630-bbba-80b90fbffb81 None None] MFA Rules not processed for user `3cfe4a71879849b581eb8b48b24107fd`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:42.913580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-133afdbb-6a1f-4630-bbba-80b90fbffb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:42.924577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 831/1654] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:42.929367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 824/1655] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:42.999468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e902fda-42bb-46d9-8c90-464a6c2a5e4c service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:43.001356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3e902fda-42bb-46d9-8c90-464a6c2a5e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:43.129838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e902fda-42bb-46d9-8c90-464a6c2a5e4c service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:43.136704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8d7fb-2ba9-41c5-b0c4-75660135dd5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:43.138795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8d7fb-2ba9-41c5-b0c4-75660135dd5f service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:43.139082 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8d7fb-2ba9-41c5-b0c4-75660135dd5f service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:43.139608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8d7fb-2ba9-41c5-b0c4-75660135dd5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:43.148911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8d7fb-2ba9-41c5-b0c4-75660135dd5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:43.151018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8d7fb-2ba9-41c5-b0c4-75660135dd5f service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:43.166838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 832/1656] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:44.101040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133afdbb-6a1f-4630-bbba-80b90fbffb81 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:44.103303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-133afdbb-6a1f-4630-bbba-80b90fbffb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:44.145645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e678a2-288c-4ac2-b03e-62879f048d1e None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:44.146568 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e678a2-288c-4ac2-b03e-62879f048d1e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:44.147016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e678a2-288c-4ac2-b03e-62879f048d1e None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:44.149616 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 833/1657] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jan 27 16:48:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:48:44.156827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230d58-e0fc-4f79-aab8-a008f228eeb4 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:44.157717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230d58-e0fc-4f79-aab8-a008f228eeb4 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:44.158178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b230d58-e0fc-4f79-aab8-a008f228eeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:44.196692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2b230d58-e0fc-4f79-aab8-a008f228eeb4 None None] MFA Rules not processed for user `15ae418635734639a4d10676978e82cf`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:44.198910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2b230d58-e0fc-4f79-aab8-a008f228eeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:44.223050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 834/1658] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:48:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:48:44.259013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b230d58-e0fc-4f79-aab8-a008f228eeb4 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:44.282085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b230d58-e0fc-4f79-aab8-a008f228eeb4 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:44.294429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f76d43-f3df-4284-ae3e-ff492782f838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:44.296439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f76d43-f3df-4284-ae3e-ff492782f838 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:44.296899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f76d43-f3df-4284-ae3e-ff492782f838 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:44.298228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f76d43-f3df-4284-ae3e-ff492782f838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:44.317322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f76d43-f3df-4284-ae3e-ff492782f838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:44.318893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f76d43-f3df-4284-ae3e-ff492782f838 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:44.336745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133afdbb-6a1f-4630-bbba-80b90fbffb81 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:44.342200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 835/1659] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:44.349867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a854c9-8a71-49be-88b8-f5ceaba20a2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5bbcf690d144ab99438b3f65b5e100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:44.351101 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a854c9-8a71-49be-88b8-f5ceaba20a2f service placement] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:44.351652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a854c9-8a71-49be-88b8-f5ceaba20a2f service placement] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:44.352039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a854c9-8a71-49be-88b8-f5ceaba20a2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:44.354077 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-27a854c9-8a71-49be-88b8-f5ceaba20a2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:44.387997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a854c9-8a71-49be-88b8-f5ceaba20a2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:44.389761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a854c9-8a71-49be-88b8-f5ceaba20a2f service placement] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:44.403558 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 825/1660] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:44.535379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f76d43-f3df-4284-ae3e-ff492782f838 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:44.536956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b2f76d43-f3df-4284-ae3e-ff492782f838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:44.563338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f76d43-f3df-4284-ae3e-ff492782f838 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:44.571031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:44.572163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:44.572754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:44.573189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] PATH_INFO: `/v3/projects/7ffef7f348f141d69256d35c3c174bf3` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:44.575617 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ffef7f348f141d69256d35c3c174bf3)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:44.577423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: WARNING py.warnings [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:48:44.577423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: warnings.warn(msg) Jan 27 16:48:44.577423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: Jan 27 16:48:44.588908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:44.714291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ffef7f348f141d69256d35c3c174bf3', 'request_id': 'req-7b60f47d-b048-4583-a4eb-44a5321ad1e9'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:44.745671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ffef7f348f141d69256d35c3c174bf3', 'request_id': 'req-7b60f47d-b048-4583-a4eb-44a5321ad1e9'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:44.764228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ffef7f348f141d69256d35c3c174bf3', 'request_id': 'req-7b60f47d-b048-4583-a4eb-44a5321ad1e9'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:44.808625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] The token cache is being invalidate because project 7ffef7f348f141d69256d35c3c174bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:48:44.810225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:44.812469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7b60f47d-b048-4583-a4eb-44a5321ad1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:44.822395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 836/1661] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:48:44 2022] DELETE /identity/v3/projects/7ffef7f348f141d69256d35c3c174bf3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:44.823594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3684c-0f9e-4662-a815-93f126d365b4 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:44.828498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3684c-0f9e-4662-a815-93f126d365b4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:44.829603 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3684c-0f9e-4662-a815-93f126d365b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:44.896918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-deb3684c-0f9e-4662-a815-93f126d365b4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:44.901274 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-deb3684c-0f9e-4662-a815-93f126d365b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:45.073203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 826/1662] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:45.081253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c56b-636d-4aad-b83c-89fa9397adfb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:45.081536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c56b-636d-4aad-b83c-89fa9397adfb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:45.081823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c56b-636d-4aad-b83c-89fa9397adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:45.113220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7361c56b-636d-4aad-b83c-89fa9397adfb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:45.114742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7361c56b-636d-4aad-b83c-89fa9397adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:45.137393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 837/1663] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:45.142040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3684c-0f9e-4662-a815-93f126d365b4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:45.156654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3684c-0f9e-4662-a815-93f126d365b4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:45.168802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29ff41-c2ee-4dbe-946b-15dd15ecc313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:45.169627 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29ff41-c2ee-4dbe-946b-15dd15ecc313 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:45.169982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29ff41-c2ee-4dbe-946b-15dd15ecc313 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:45.170377 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29ff41-c2ee-4dbe-946b-15dd15ecc313 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:45.172277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29ff41-c2ee-4dbe-946b-15dd15ecc313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:45.172810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29ff41-c2ee-4dbe-946b-15dd15ecc313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:45.175746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29ff41-c2ee-4dbe-946b-15dd15ecc313 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:45.192770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 827/1664] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:45.196958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361c56b-636d-4aad-b83c-89fa9397adfb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:45.209809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361c56b-636d-4aad-b83c-89fa9397adfb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:45.222774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9b3c-44e5-40d9-b414-6ecc56a67666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:45.225118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9b3c-44e5-40d9-b414-6ecc56a67666 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:45.225970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9b3c-44e5-40d9-b414-6ecc56a67666 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:45.226472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9b3c-44e5-40d9-b414-6ecc56a67666 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:45.228057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f9b3c-44e5-40d9-b414-6ecc56a67666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:45.235995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f9b3c-44e5-40d9-b414-6ecc56a67666 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:45.325114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 838/1665] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:45 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:45.331458 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29ff41-c2ee-4dbe-946b-15dd15ecc313 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:45.359849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29ff41-c2ee-4dbe-946b-15dd15ecc313 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:45.526873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80265001-16fa-46a1-890d-bc43f9cf2614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:45.528238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80265001-16fa-46a1-890d-bc43f9cf2614 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:45.528810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80265001-16fa-46a1-890d-bc43f9cf2614 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:45.529870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80265001-16fa-46a1-890d-bc43f9cf2614 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:45.531247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80265001-16fa-46a1-890d-bc43f9cf2614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:45.533964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80265001-16fa-46a1-890d-bc43f9cf2614 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:45.580395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 828/1666] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:45 2022] POST /identity/v3/users => generated 303 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:45.584108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9b3c-44e5-40d9-b414-6ecc56a67666 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:45.600712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9b3c-44e5-40d9-b414-6ecc56a67666 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:45.609699 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33a5f7-01cf-4a96-b0b3-f18fcc5dcfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:45.610825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33a5f7-01cf-4a96-b0b3-f18fcc5dcfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:45.611318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33a5f7-01cf-4a96-b0b3-f18fcc5dcfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:45.612470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33a5f7-01cf-4a96-b0b3-f18fcc5dcfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:45.613691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33a5f7-01cf-4a96-b0b3-f18fcc5dcfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:45.616062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33a5f7-01cf-4a96-b0b3-f18fcc5dcfd3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:45.671829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 839/1667] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:45.672166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80265001-16fa-46a1-890d-bc43f9cf2614 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:45.688389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80265001-16fa-46a1-890d-bc43f9cf2614 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:45.712878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db1299-c5b9-4e95-a6ac-8d3015118a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:45.713786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db1299-c5b9-4e95-a6ac-8d3015118a06 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:45.714347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db1299-c5b9-4e95-a6ac-8d3015118a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:45.716170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db1299-c5b9-4e95-a6ac-8d3015118a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:45.717221 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db1299-c5b9-4e95-a6ac-8d3015118a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:45.727713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db1299-c5b9-4e95-a6ac-8d3015118a06 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:45.765475 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 829/1668] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:48:45.769502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33a5f7-01cf-4a96-b0b3-f18fcc5dcfd3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:45.791893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33a5f7-01cf-4a96-b0b3-f18fcc5dcfd3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:45.814615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b01c-e3cf-45d2-ab34-045731d94ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:45.815443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b01c-e3cf-45d2-ab34-045731d94ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:45.815815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b01c-e3cf-45d2-ab34-045731d94ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:45.816094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0b01c-e3cf-45d2-ab34-045731d94ec8 admin admin] PATH_INFO: `/v3/projects/bc9ddf51191e4d33b866e3b1ee247655/users/95d3b6fe91e347f5812ba1ab440647bc/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:45.889293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0b01c-e3cf-45d2-ab34-045731d94ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9ddf51191e4d33b866e3b1ee247655, user_id=95d3b6fe91e347f5812ba1ab440647bc, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:45.894803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0b01c-e3cf-45d2-ab34-045731d94ec8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:45.940726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 840/1669] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:45 2022] PUT /identity/v3/projects/bc9ddf51191e4d33b866e3b1ee247655/users/95d3b6fe91e347f5812ba1ab440647bc/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:45.946348 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e1222-9a4a-439e-b51c-a02cb08efc84 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:45.946686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e1222-9a4a-439e-b51c-a02cb08efc84 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:45.946983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e1222-9a4a-439e-b51c-a02cb08efc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:45.999114 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-4d3e1222-9a4a-439e-b51c-a02cb08efc84 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:46.000262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4d3e1222-9a4a-439e-b51c-a02cb08efc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:46.045741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b01c-e3cf-45d2-ab34-045731d94ec8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:46.047553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-90e0b01c-e3cf-45d2-ab34-045731d94ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:46.155096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0b01c-e3cf-45d2-ab34-045731d94ec8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:46.165311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:46.167366 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:46.169538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:46.169538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] PATH_INFO: `/v3/users/8dabc55230a9416f869637f55c70b0eb` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:46.172780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dabc55230a9416f869637f55c70b0eb)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:46.177605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:46.219694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 830/1670] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:46.282991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e1222-9a4a-439e-b51c-a02cb08efc84 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:46.284867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4d3e1222-9a4a-439e-b51c-a02cb08efc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:46.341766 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dabc55230a9416f869637f55c70b0eb'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:46.367561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dabc55230a9416f869637f55c70b0eb'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:46.414558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dabc55230a9416f869637f55c70b0eb'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:46.445832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dabc55230a9416f869637f55c70b0eb'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:46.452746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3d0e9421-6ddf-49d2-8294-8e685a60d583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dabc55230a9416f869637f55c70b0eb'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:46.483595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 841/1671] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:48:46 2022] DELETE /identity/v3/users/8dabc55230a9416f869637f55c70b0eb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:46.488393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1420-31f6-4265-a803-8d230e6b8748 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:46.492618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1420-31f6-4265-a803-8d230e6b8748 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:46.504062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed1420-31f6-4265-a803-8d230e6b8748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:46.536144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e1222-9a4a-439e-b51c-a02cb08efc84 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:46.605258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-47ed1420-31f6-4265-a803-8d230e6b8748 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:46.606577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-47ed1420-31f6-4265-a803-8d230e6b8748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:46.757729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac56f9-6beb-4afa-aa46-1b53f6915103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:46.760044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac56f9-6beb-4afa-aa46-1b53f6915103 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:46.760385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac56f9-6beb-4afa-aa46-1b53f6915103 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:46.760688 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac56f9-6beb-4afa-aa46-1b53f6915103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:46.768383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e4ac56f9-6beb-4afa-aa46-1b53f6915103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:46.825125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 842/1672] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:46.943012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1420-31f6-4265-a803-8d230e6b8748 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:46.944481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-47ed1420-31f6-4265-a803-8d230e6b8748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:46.976333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed1420-31f6-4265-a803-8d230e6b8748 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:46.993788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08ee2c-e5a0-4a5e-bf58-49d771f1d2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:46.994473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08ee2c-e5a0-4a5e-bf58-49d771f1d2ea service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:46.994764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08ee2c-e5a0-4a5e-bf58-49d771f1d2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:46.995044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08ee2c-e5a0-4a5e-bf58-49d771f1d2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:47.012477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac56f9-6beb-4afa-aa46-1b53f6915103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:47.017196 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac56f9-6beb-4afa-aa46-1b53f6915103 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:47.039463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08ee2c-e5a0-4a5e-bf58-49d771f1d2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:47.040986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08ee2c-e5a0-4a5e-bf58-49d771f1d2ea service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:47.058392 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 831/1673] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:48:47.090100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 843/1674] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:48.011397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05081da8-b276-4f18-8e56-411595c41c53 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:48.012166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05081da8-b276-4f18-8e56-411595c41c53 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:48.012255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05081da8-b276-4f18-8e56-411595c41c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:48.086751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-05081da8-b276-4f18-8e56-411595c41c53 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:48.092909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-05081da8-b276-4f18-8e56-411595c41c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:48.226271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 832/1675] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:48:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:48.576720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08ee2c-e5a0-4a5e-bf58-49d771f1d2ea service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:48.578276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2f08ee2c-e5a0-4a5e-bf58-49d771f1d2ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:48.696965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08ee2c-e5a0-4a5e-bf58-49d771f1d2ea service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:48.704917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eafbf3-4671-4501-8ee4-bd9c5be7d801 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:48.706088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eafbf3-4671-4501-8ee4-bd9c5be7d801 service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:48.706725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eafbf3-4671-4501-8ee4-bd9c5be7d801 service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:48.707212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eafbf3-4671-4501-8ee4-bd9c5be7d801 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:48.725329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eafbf3-4671-4501-8ee4-bd9c5be7d801 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:48.733951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eafbf3-4671-4501-8ee4-bd9c5be7d801 service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:48.744963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 844/1676] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:48:48.957632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05081da8-b276-4f18-8e56-411595c41c53 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:48.959539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-05081da8-b276-4f18-8e56-411595c41c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:48.999285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05081da8-b276-4f18-8e56-411595c41c53 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:49.019837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:49.024432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:49.026244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:49.026543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] PATH_INFO: `/v3/projects/ff1a8d4f9ee74f18bc46f2412818ad0d` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:49.031283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1a8d4f9ee74f18bc46f2412818ad0d)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:49.038551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:49.198788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1a8d4f9ee74f18bc46f2412818ad0d', 'request_id': 'req-d565bc03-2514-46c2-ac83-2adea8a305fc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:49.229410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1a8d4f9ee74f18bc46f2412818ad0d', 'request_id': 'req-d565bc03-2514-46c2-ac83-2adea8a305fc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:49.243426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1a8d4f9ee74f18bc46f2412818ad0d', 'request_id': 'req-d565bc03-2514-46c2-ac83-2adea8a305fc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:49.290312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] The token cache is being invalidate because project ff1a8d4f9ee74f18bc46f2412818ad0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:48:49.290615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:49.291285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d565bc03-2514-46c2-ac83-2adea8a305fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:49.293491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 833/1677] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:48:48 2022] DELETE /identity/v3/projects/ff1a8d4f9ee74f18bc46f2412818ad0d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:49.300298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeb717-e6e4-4152-b3b7-ffa4a3f83069 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:49.311741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeb717-e6e4-4152-b3b7-ffa4a3f83069 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:49.311741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeb717-e6e4-4152-b3b7-ffa4a3f83069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:49.361495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-eddeb717-e6e4-4152-b3b7-ffa4a3f83069 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:49.365346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-eddeb717-e6e4-4152-b3b7-ffa4a3f83069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:49.548104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 845/1678] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:49.554209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a65b6-f038-4723-b3d8-631ded7e1442 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:49.554573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a65b6-f038-4723-b3d8-631ded7e1442 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:49.554816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a65b6-f038-4723-b3d8-631ded7e1442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:49.597483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-3b4a65b6-f038-4723-b3d8-631ded7e1442 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:49.599302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3b4a65b6-f038-4723-b3d8-631ded7e1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:49.623412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 834/1679] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:49.626180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeb717-e6e4-4152-b3b7-ffa4a3f83069 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:49.654006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeb717-e6e4-4152-b3b7-ffa4a3f83069 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:49.701557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde37a1-50ae-471a-8847-573bd5f98482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:49.702338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde37a1-50ae-471a-8847-573bd5f98482 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:49.707732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde37a1-50ae-471a-8847-573bd5f98482 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:49.708115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde37a1-50ae-471a-8847-573bd5f98482 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:49.708933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde37a1-50ae-471a-8847-573bd5f98482 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:49.709244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde37a1-50ae-471a-8847-573bd5f98482 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:49.710953 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde37a1-50ae-471a-8847-573bd5f98482 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:49.771052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a65b6-f038-4723-b3d8-631ded7e1442 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:49.771274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 846/1680] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:49.797064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a65b6-f038-4723-b3d8-631ded7e1442 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:49.818314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267bb88-9abf-45f1-9481-a0a657c718ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:49.819309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267bb88-9abf-45f1-9481-a0a657c718ef admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:49.819754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267bb88-9abf-45f1-9481-a0a657c718ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:49.820804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267bb88-9abf-45f1-9481-a0a657c718ef admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:49.821652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267bb88-9abf-45f1-9481-a0a657c718ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:49.832210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267bb88-9abf-45f1-9481-a0a657c718ef admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:49.909357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 835/1681] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:49 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:48:49.913793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde37a1-50ae-471a-8847-573bd5f98482 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:49.929259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde37a1-50ae-471a-8847-573bd5f98482 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:50.112998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55ffb1-e771-462e-981e-c55273d5c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:50.113686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55ffb1-e771-462e-981e-c55273d5c2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:50.113966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55ffb1-e771-462e-981e-c55273d5c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:50.114376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55ffb1-e771-462e-981e-c55273d5c2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:50.115109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55ffb1-e771-462e-981e-c55273d5c2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:50.117275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55ffb1-e771-462e-981e-c55273d5c2d8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:50.208272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267bb88-9abf-45f1-9481-a0a657c718ef admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:50.217868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 847/1682] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:49 2022] POST /identity/v3/users => generated 302 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:50.220428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267bb88-9abf-45f1-9481-a0a657c718ef admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:50.251555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74728455-69b7-4ac4-bda6-4a141ff036b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:50.252321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728455-69b7-4ac4-bda6-4a141ff036b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:50.252601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728455-69b7-4ac4-bda6-4a141ff036b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:50.252885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74728455-69b7-4ac4-bda6-4a141ff036b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:50.253863 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74728455-69b7-4ac4-bda6-4a141ff036b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:50.269218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74728455-69b7-4ac4-bda6-4a141ff036b9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:50.343102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 836/1683] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:50.346989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55ffb1-e771-462e-981e-c55273d5c2d8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:50.360281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55ffb1-e771-462e-981e-c55273d5c2d8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:50.410558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaccdd-9b45-4d63-9a50-432c321fc7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:50.411382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaccdd-9b45-4d63-9a50-432c321fc7bc admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:50.411953 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaccdd-9b45-4d63-9a50-432c321fc7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:50.414718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaccdd-9b45-4d63-9a50-432c321fc7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:50.415607 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaccdd-9b45-4d63-9a50-432c321fc7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:50.428181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaccdd-9b45-4d63-9a50-432c321fc7bc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:50.444703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 848/1684] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:50.448834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74728455-69b7-4ac4-bda6-4a141ff036b9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:50.467638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74728455-69b7-4ac4-bda6-4a141ff036b9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:50.481126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aeff3-8a9a-4ec0-81a2-545cad167a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:50.482561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aeff3-8a9a-4ec0-81a2-545cad167a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:50.483024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aeff3-8a9a-4ec0-81a2-545cad167a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:50.483470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aeff3-8a9a-4ec0-81a2-545cad167a58 admin admin] PATH_INFO: `/v3/projects/b4cc310f9f8645d5b7f47e733771f8f1/users/7882638e086a4799a0b8419dda02655c/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:50.529463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147aeff3-8a9a-4ec0-81a2-545cad167a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4cc310f9f8645d5b7f47e733771f8f1, user_id=7882638e086a4799a0b8419dda02655c, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:50.534350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147aeff3-8a9a-4ec0-81a2-545cad167a58 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:50.568197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 837/1685] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:50 2022] PUT /identity/v3/projects/b4cc310f9f8645d5b7f47e733771f8f1/users/7882638e086a4799a0b8419dda02655c/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:50.588024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9e9b4-4aec-40c1-b67e-b9e3f37501a8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:50.588024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9e9b4-4aec-40c1-b67e-b9e3f37501a8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:50.588024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9e9b4-4aec-40c1-b67e-b9e3f37501a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:50.678996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2fa9e9b4-4aec-40c1-b67e-b9e3f37501a8 None None] MFA Rules not processed for user `7882638e086a4799a0b8419dda02655c`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:50.680680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2fa9e9b4-4aec-40c1-b67e-b9e3f37501a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:50.841084 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 849/1686] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:50.841295 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aeff3-8a9a-4ec0-81a2-545cad167a58 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:51.053553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aeff3-8a9a-4ec0-81a2-545cad167a58 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:51.070073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d7222-ea4c-45fc-84fe-451dad84d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:51.070836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d7222-ea4c-45fc-84fe-451dad84d393 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:51.071196 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d7222-ea4c-45fc-84fe-451dad84d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:51.071822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d7222-ea4c-45fc-84fe-451dad84d393 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:51.075186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d7222-ea4c-45fc-84fe-451dad84d393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:51.089338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d7222-ea4c-45fc-84fe-451dad84d393 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:51.179992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 838/1687] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:50 2022] POST /identity/v3/projects => generated 403 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:51.181360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9e9b4-4aec-40c1-b67e-b9e3f37501a8 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:51.201262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9e9b4-4aec-40c1-b67e-b9e3f37501a8 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:51.354951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d785-c1e5-4d95-9162-275863e0641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:51.356911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d785-c1e5-4d95-9162-275863e0641a admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:51.357465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d785-c1e5-4d95-9162-275863e0641a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:51.357852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d785-c1e5-4d95-9162-275863e0641a admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:51.359991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7d785-c1e5-4d95-9162-275863e0641a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:51.363419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7d785-c1e5-4d95-9162-275863e0641a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:51.413024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 850/1688] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:51 2022] POST /identity/v3/users => generated 308 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:51.413608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d7222-ea4c-45fc-84fe-451dad84d393 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:51.442363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d7222-ea4c-45fc-84fe-451dad84d393 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:51.452317 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbee2b8-befb-43e6-b26b-a4cf9f479179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:51.454000 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbee2b8-befb-43e6-b26b-a4cf9f479179 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:51.454491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbee2b8-befb-43e6-b26b-a4cf9f479179 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:51.454974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbee2b8-befb-43e6-b26b-a4cf9f479179 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:51.458793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbee2b8-befb-43e6-b26b-a4cf9f479179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:51.460809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbee2b8-befb-43e6-b26b-a4cf9f479179 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:51.499823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 839/1689] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:51.505181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d785-c1e5-4d95-9162-275863e0641a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:51.535300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d785-c1e5-4d95-9162-275863e0641a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:51.580885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8fa11-1f83-46d0-9c28-39d1bed46313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:51.584394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8fa11-1f83-46d0-9c28-39d1bed46313 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:51.585240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8fa11-1f83-46d0-9c28-39d1bed46313 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:51.586115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8fa11-1f83-46d0-9c28-39d1bed46313 admin admin] PATH_INFO: `/v3/projects/07e2fd1d5cea4b53b8a8826e926b52fe/users/e444a8584dc84be195dd3e7100595c45/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:51.665185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8fa11-1f83-46d0-9c28-39d1bed46313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e2fd1d5cea4b53b8a8826e926b52fe, user_id=e444a8584dc84be195dd3e7100595c45, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:51.671690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8fa11-1f83-46d0-9c28-39d1bed46313 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:51.723391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 851/1690] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:51 2022] PUT /identity/v3/projects/07e2fd1d5cea4b53b8a8826e926b52fe/users/e444a8584dc84be195dd3e7100595c45/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:51.727525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbee2b8-befb-43e6-b26b-a4cf9f479179 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:51.742569 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbee2b8-befb-43e6-b26b-a4cf9f479179 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:51.914816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521b61-a1d0-4481-aece-224dd030140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:51.917168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521b61-a1d0-4481-aece-224dd030140c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:51.919693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521b61-a1d0-4481-aece-224dd030140c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:51.921619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b521b61-a1d0-4481-aece-224dd030140c admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:51.922896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521b61-a1d0-4481-aece-224dd030140c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:51.929717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8fa11-1f83-46d0-9c28-39d1bed46313 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:51.930519 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b521b61-a1d0-4481-aece-224dd030140c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:51.931782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a2e8fa11-1f83-46d0-9c28-39d1bed46313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:51.966795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 840/1691] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:51.967936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521b61-a1d0-4481-aece-224dd030140c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:51.969190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8fa11-1f83-46d0-9c28-39d1bed46313 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:51.994885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:51.996703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:51.997238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:51.997528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] PATH_INFO: `/v3/users/9d06d4594164459da44b5a1f17b08498` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:52.000791 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b521b61-a1d0-4481-aece-224dd030140c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:52.002765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d06d4594164459da44b5a1f17b08498)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:52.005246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:52.021442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598afc2-97dd-41c8-bcc2-4b5af1a4095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:52.022990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598afc2-97dd-41c8-bcc2-4b5af1a4095d admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:52.023588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598afc2-97dd-41c8-bcc2-4b5af1a4095d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:52.024222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598afc2-97dd-41c8-bcc2-4b5af1a4095d admin admin] PATH_INFO: `/v3/projects/07e2fd1d5cea4b53b8a8826e926b52fe/users/e444a8584dc84be195dd3e7100595c45/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:52.029582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598afc2-97dd-41c8-bcc2-4b5af1a4095d admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e2fd1d5cea4b53b8a8826e926b52fe, user_id=e444a8584dc84be195dd3e7100595c45, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:52.039132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598afc2-97dd-41c8-bcc2-4b5af1a4095d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:52.066423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 841/1692] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:51 2022] PUT /identity/v3/projects/07e2fd1d5cea4b53b8a8826e926b52fe/users/e444a8584dc84be195dd3e7100595c45/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:52.081918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d0b0b-3650-49bd-a185-8ba798d5010b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:52.082248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d0b0b-3650-49bd-a185-8ba798d5010b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:52.082531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d0b0b-3650-49bd-a185-8ba798d5010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:52.114159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-bd3d0b0b-3650-49bd-a185-8ba798d5010b None None] MFA Rules not processed for user `e444a8584dc84be195dd3e7100595c45`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:52.116226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-bd3d0b0b-3650-49bd-a185-8ba798d5010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:52.138836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d06d4594164459da44b5a1f17b08498'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:52.158705 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d06d4594164459da44b5a1f17b08498'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:52.182005 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d06d4594164459da44b5a1f17b08498'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:52.199330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d06d4594164459da44b5a1f17b08498'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:52.200463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7e1ec9ce-5c15-4c60-a5ff-8b201e1d80b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d06d4594164459da44b5a1f17b08498'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:52.225451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 852/1693] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:48:51 2022] DELETE /identity/v3/users/9d06d4594164459da44b5a1f17b08498 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:48:52.229818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a8f7-133e-41f1-8189-a5d528cd8522 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:52.230114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a8f7-133e-41f1-8189-a5d528cd8522 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:52.230983 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a8f7-133e-41f1-8189-a5d528cd8522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:52.296782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-12c8a8f7-133e-41f1-8189-a5d528cd8522 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:52.304939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-12c8a8f7-133e-41f1-8189-a5d528cd8522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:52.407761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 842/1694] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:52.420360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d0b0b-3650-49bd-a185-8ba798d5010b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:52.422071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-bd3d0b0b-3650-49bd-a185-8ba798d5010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:52.555004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 853/1695] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:48:52.602400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a8f7-133e-41f1-8189-a5d528cd8522 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:52.604979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-12c8a8f7-133e-41f1-8189-a5d528cd8522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:52.645207 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d0b0b-3650-49bd-a185-8ba798d5010b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:52.769232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a8f7-133e-41f1-8189-a5d528cd8522 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:52.787493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f188b0d-c91f-4c85-82ce-d056cb7c897a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:52.788591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188b0d-c91f-4c85-82ce-d056cb7c897a service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:52.789348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188b0d-c91f-4c85-82ce-d056cb7c897a service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:52.789981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f188b0d-c91f-4c85-82ce-d056cb7c897a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:52.831147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5340003a-4ae3-4b35-adf8-88614aef237f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:52.831844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340003a-4ae3-4b35-adf8-88614aef237f service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:52.832127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340003a-4ae3-4b35-adf8-88614aef237f service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:52.832231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f188b0d-c91f-4c85-82ce-d056cb7c897a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:52.832397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340003a-4ae3-4b35-adf8-88614aef237f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:52.838454 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f188b0d-c91f-4c85-82ce-d056cb7c897a service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:52.857468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 854/1696] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:48:53.012937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340003a-4ae3-4b35-adf8-88614aef237f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:53.014479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5340003a-4ae3-4b35-adf8-88614aef237f service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:53.070596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 843/1697] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:48:53.319695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f188b0d-c91f-4c85-82ce-d056cb7c897a service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:53.322025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7f188b0d-c91f-4c85-82ce-d056cb7c897a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:53.363075 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f188b0d-c91f-4c85-82ce-d056cb7c897a service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:53.380973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:53.381885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:53.382173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:53.382457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] PATH_INFO: `/v3/users/7882638e086a4799a0b8419dda02655c` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:53.383993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7882638e086a4799a0b8419dda02655c)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:53.393178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:53.531023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7882638e086a4799a0b8419dda02655c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:53.562130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7882638e086a4799a0b8419dda02655c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:53.608316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7882638e086a4799a0b8419dda02655c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:53.629271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7882638e086a4799a0b8419dda02655c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:53.631222 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7882638e086a4799a0b8419dda02655c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:53.645499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 855/1698] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:48:53 2022] DELETE /identity/v3/users/7882638e086a4799a0b8419dda02655c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:53.650754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fd051-aaf7-4e42-9d30-25dcde115540 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:53.651806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fd051-aaf7-4e42-9d30-25dcde115540 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:53.652452 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fd051-aaf7-4e42-9d30-25dcde115540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:53.688033 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ad3fd051-aaf7-4e42-9d30-25dcde115540 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:53.690147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ad3fd051-aaf7-4e42-9d30-25dcde115540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:53.788319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 844/1699] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:53.888306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:53.890851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:54.124270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708876d-dd29-4773-ade0-e60a25370d54 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:54.142471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4c5e1-ef8a-4866-a2ef-d13e5ecf0da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:54.144800 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4c5e1-ef8a-4866-a2ef-d13e5ecf0da2 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:54.145623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4c5e1-ef8a-4866-a2ef-d13e5ecf0da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:54.145623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4c5e1-ef8a-4866-a2ef-d13e5ecf0da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:54.149945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3117b1-50cd-468a-93b8-13c8b90117c5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:54.150286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3117b1-50cd-468a-93b8-13c8b90117c5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:54.150825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3117b1-50cd-468a-93b8-13c8b90117c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:54.216459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4c5e1-ef8a-4866-a2ef-d13e5ecf0da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:54.219053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4c5e1-ef8a-4866-a2ef-d13e5ecf0da2 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:54.270893 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-7a3117b1-50cd-468a-93b8-13c8b90117c5 None None] MFA Rules not processed for user `20137a83d3de4dcfaba05ab93c470829`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:54.275173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7a3117b1-50cd-468a-93b8-13c8b90117c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:54.279859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 856/1700] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:54.284238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccddaa-1ebd-40fa-874e-1ed096b86295 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:54.284532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccddaa-1ebd-40fa-874e-1ed096b86295 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:54.288634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccddaa-1ebd-40fa-874e-1ed096b86295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:54.403296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-43ccddaa-1ebd-40fa-874e-1ed096b86295 None None] MFA Rules not processed for user `95d3b6fe91e347f5812ba1ab440647bc`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:54.409410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-43ccddaa-1ebd-40fa-874e-1ed096b86295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:54.557781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 845/1701] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:54.559212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3117b1-50cd-468a-93b8-13c8b90117c5 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:54.561477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7a3117b1-50cd-468a-93b8-13c8b90117c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:54.672704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 857/1702] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:54.673879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccddaa-1ebd-40fa-874e-1ed096b86295 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:54.684434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-43ccddaa-1ebd-40fa-874e-1ed096b86295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:54.738686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccddaa-1ebd-40fa-874e-1ed096b86295 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:54.776390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef7334-1abd-4cdb-a528-c123b83c94ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:54.777637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef7334-1abd-4cdb-a528-c123b83c94ab admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:54.777901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef7334-1abd-4cdb-a528-c123b83c94ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:54.780961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef7334-1abd-4cdb-a528-c123b83c94ab admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:54.783764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef7334-1abd-4cdb-a528-c123b83c94ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:54.788511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ef7334-1abd-4cdb-a528-c123b83c94ab admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:54.846970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3117b1-50cd-468a-93b8-13c8b90117c5 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:54.865679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 858/1703] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:54 2022] POST /identity/v3/projects => generated 405 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:54.866529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc3e95-350e-48a0-9f76-5802fc806d8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:54.867208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc3e95-350e-48a0-9f76-5802fc806d8d service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:54.867501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc3e95-350e-48a0-9f76-5802fc806d8d service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:54.867809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc3e95-350e-48a0-9f76-5802fc806d8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:54.869572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef7334-1abd-4cdb-a528-c123b83c94ab admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:54.892901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc3e95-350e-48a0-9f76-5802fc806d8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:54.894629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc3e95-350e-48a0-9f76-5802fc806d8d service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:54.982576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 846/1704] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:55.102301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef7334-1abd-4cdb-a528-c123b83c94ab admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:55.135952 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42cc62-9bb1-4f6f-96c0-3c597f0ca3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:55.136767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42cc62-9bb1-4f6f-96c0-3c597f0ca3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:55.137061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42cc62-9bb1-4f6f-96c0-3c597f0ca3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:55.137342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42cc62-9bb1-4f6f-96c0-3c597f0ca3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:55.138075 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42cc62-9bb1-4f6f-96c0-3c597f0ca3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:55.163008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42cc62-9bb1-4f6f-96c0-3c597f0ca3b8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:55.261211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 859/1705] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:54 2022] POST /identity/v3/users => generated 309 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:55.266044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc3e95-350e-48a0-9f76-5802fc806d8d service nova] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:55.285691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc3e95-350e-48a0-9f76-5802fc806d8d service nova] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:55.300495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e22ea-69be-49e9-9fd6-95d25f50330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:55.301535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e22ea-69be-49e9-9fd6-95d25f50330f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:55.306501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e22ea-69be-49e9-9fd6-95d25f50330f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:55.307073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e22ea-69be-49e9-9fd6-95d25f50330f admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:55.313835 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e22ea-69be-49e9-9fd6-95d25f50330f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:55.315951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e22ea-69be-49e9-9fd6-95d25f50330f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:55.352055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42cc62-9bb1-4f6f-96c0-3c597f0ca3b8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:55.352730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 847/1706] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:48:55.371741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42cc62-9bb1-4f6f-96c0-3c597f0ca3b8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:55.385971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e22ea-69be-49e9-9fd6-95d25f50330f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:55.387047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d6ef0-5d93-4bbf-b56d-73049b2933ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:55.389055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d6ef0-5d93-4bbf-b56d-73049b2933ec admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:55.390267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f54e22ea-69be-49e9-9fd6-95d25f50330f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:55.392865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d6ef0-5d93-4bbf-b56d-73049b2933ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:55.393895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d6ef0-5d93-4bbf-b56d-73049b2933ec admin admin] PATH_INFO: `/v3/projects/6539c4a1302e4f7cb740a68cc7f77010/users/afaf7700714045e3b1c445341651b8b7/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:55.434473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e22ea-69be-49e9-9fd6-95d25f50330f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:55.446531 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d6ef0-5d93-4bbf-b56d-73049b2933ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6539c4a1302e4f7cb740a68cc7f77010, user_id=afaf7700714045e3b1c445341651b8b7, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:55.448049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:55.449232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:55.456421 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:55.457014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] PATH_INFO: `/v3/projects/52b9c1434f884b9d9253c9bb1bd33340` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:55.460734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d6ef0-5d93-4bbf-b56d-73049b2933ec admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:55.461748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b9c1434f884b9d9253c9bb1bd33340)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:55.476614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:55.503055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 860/1707] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:55 2022] PUT /identity/v3/projects/6539c4a1302e4f7cb740a68cc7f77010/users/afaf7700714045e3b1c445341651b8b7/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:55.507876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d6ef0-5d93-4bbf-b56d-73049b2933ec admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:55.628636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b9c1434f884b9d9253c9bb1bd33340', 'request_id': 'req-5892981f-fc66-435c-af46-53f326a1bea4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:55.647381 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b9c1434f884b9d9253c9bb1bd33340', 'request_id': 'req-5892981f-fc66-435c-af46-53f326a1bea4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:55.661129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b9c1434f884b9d9253c9bb1bd33340', 'request_id': 'req-5892981f-fc66-435c-af46-53f326a1bea4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:55.693032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] The token cache is being invalidate because project 52b9c1434f884b9d9253c9bb1bd33340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:48:55.693606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:55.695606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5892981f-fc66-435c-af46-53f326a1bea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:55.702377 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 848/1708] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:48:55 2022] DELETE /identity/v3/projects/52b9c1434f884b9d9253c9bb1bd33340 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:48:55.705892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d6ef0-5d93-4bbf-b56d-73049b2933ec admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:55.708299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3638e-491b-42b1-8146-f4fa25b43048 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:55.708770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3638e-491b-42b1-8146-f4fa25b43048 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:55.709300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3638e-491b-42b1-8146-f4fa25b43048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:55.771967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-cfe3638e-491b-42b1-8146-f4fa25b43048 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:55.775213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cfe3638e-491b-42b1-8146-f4fa25b43048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:55.878763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016fda-b452-4b99-99db-3eeed1fb72e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:55.879662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016fda-b452-4b99-99db-3eeed1fb72e2 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:55.879965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016fda-b452-4b99-99db-3eeed1fb72e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:55.880299 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016fda-b452-4b99-99db-3eeed1fb72e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:55.881041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016fda-b452-4b99-99db-3eeed1fb72e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:55.882711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016fda-b452-4b99-99db-3eeed1fb72e2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:55.911681 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 861/1709] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:55.912726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016fda-b452-4b99-99db-3eeed1fb72e2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:55.918570 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-de016fda-b452-4b99-99db-3eeed1fb72e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:55.932479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 849/1710] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:48:55.939632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ec39f-7b2c-4b46-9332-eff5ea58a0b4 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:55.939943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ec39f-7b2c-4b46-9332-eff5ea58a0b4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:55.940219 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ec39f-7b2c-4b46-9332-eff5ea58a0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:55.960166 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016fda-b452-4b99-99db-3eeed1fb72e2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:56.000300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-3e1ec39f-7b2c-4b46-9332-eff5ea58a0b4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:56.002237 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3e1ec39f-7b2c-4b46-9332-eff5ea58a0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:56.010965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e79089-f748-4c6e-95db-d9ad2c540363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:56.016649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e79089-f748-4c6e-95db-d9ad2c540363 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:56.021103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e79089-f748-4c6e-95db-d9ad2c540363 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:56.022464 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e79089-f748-4c6e-95db-d9ad2c540363 admin admin] PATH_INFO: `/v3/projects/6539c4a1302e4f7cb740a68cc7f77010/users/afaf7700714045e3b1c445341651b8b7/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:56.026310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 850/1711] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:48:56.027536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ec39f-7b2c-4b46-9332-eff5ea58a0b4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:56.029059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3e1ec39f-7b2c-4b46-9332-eff5ea58a0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:56.034146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e79089-f748-4c6e-95db-d9ad2c540363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6539c4a1302e4f7cb740a68cc7f77010, user_id=afaf7700714045e3b1c445341651b8b7, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:56.048663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e79089-f748-4c6e-95db-d9ad2c540363 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:56.070889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ec39f-7b2c-4b46-9332-eff5ea58a0b4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:56.086858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 862/1712] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:55 2022] PUT /identity/v3/projects/6539c4a1302e4f7cb740a68cc7f77010/users/afaf7700714045e3b1c445341651b8b7/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:56.090004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e79089-f748-4c6e-95db-d9ad2c540363 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:56.272113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:56.273164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:56.273388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:56.273669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] PATH_INFO: `/v3/projects/b4cc310f9f8645d5b7f47e733771f8f1` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:56.277487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4cc310f9f8645d5b7f47e733771f8f1)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:56.279913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:56.383811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e79089-f748-4c6e-95db-d9ad2c540363 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:56.416297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4cc310f9f8645d5b7f47e733771f8f1', 'request_id': 'req-2c62d404-bdf4-4c54-873f-caceb43423f7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:56.441246 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4cc310f9f8645d5b7f47e733771f8f1', 'request_id': 'req-2c62d404-bdf4-4c54-873f-caceb43423f7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:56.456089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4cc310f9f8645d5b7f47e733771f8f1', 'request_id': 'req-2c62d404-bdf4-4c54-873f-caceb43423f7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:56.488463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] The token cache is being invalidate because project b4cc310f9f8645d5b7f47e733771f8f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:48:56.488463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:56.490880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:56.501913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 851/1713] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:48:56 2022] DELETE /identity/v3/projects/b4cc310f9f8645d5b7f47e733771f8f1 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:56.504563 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:56.508838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:56.694942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:56.697302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:56.702330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:56.702647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:56.705080 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:48:56.706483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:56.719728 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:56.755218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 863/1714] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 668 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:48:56.755950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62d404-bdf4-4c54-873f-caceb43423f7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:56.759544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:56.768484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:56.782888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:56.785442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:56.787242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:56.787696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] PATH_INFO: `/v3/users/e444a8584dc84be195dd3e7100595c45` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:56.793403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e444a8584dc84be195dd3e7100595c45)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:56.795252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: WARNING py.warnings [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jan 27 16:48:56.795252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: warnings.warn(msg) Jan 27 16:48:56.795252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: Jan 27 16:48:56.797548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:56.801874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e96f0-f990-4856-8569-f2c69059e64a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:56.811864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964d302-ac46-484c-b137-0149ff1251e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:56.812960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964d302-ac46-484c-b137-0149ff1251e1 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:56.812960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964d302-ac46-484c-b137-0149ff1251e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:56.813155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964d302-ac46-484c-b137-0149ff1251e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:56.813918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964d302-ac46-484c-b137-0149ff1251e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:56.816078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964d302-ac46-484c-b137-0149ff1251e1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:56.872978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 864/1715] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:56 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:56.875683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964d302-ac46-484c-b137-0149ff1251e1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:56.946700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e444a8584dc84be195dd3e7100595c45'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:56.985416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e444a8584dc84be195dd3e7100595c45'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:56.986242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e444a8584dc84be195dd3e7100595c45'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:57.026095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e444a8584dc84be195dd3e7100595c45'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:57.040257 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e444a8584dc84be195dd3e7100595c45'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:57.064696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 852/1716] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:48:56 2022] DELETE /identity/v3/users/e444a8584dc84be195dd3e7100595c45 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:57.068055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964d302-ac46-484c-b137-0149ff1251e1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:57.175561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad82f3-1801-48cc-8772-d84b1ceba47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:57.176471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad82f3-1801-48cc-8772-d84b1ceba47e admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:57.176787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad82f3-1801-48cc-8772-d84b1ceba47e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:57.177148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad82f3-1801-48cc-8772-d84b1ceba47e admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:57.178207 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad82f3-1801-48cc-8772-d84b1ceba47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:57.180896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad82f3-1801-48cc-8772-d84b1ceba47e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:57.231434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 865/1717] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:56 2022] POST /identity/v3/users => generated 297 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:57.235545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:57.239239 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:57.258417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189eb00a-97f2-46f4-a678-6e27ec610641 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:57.265856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb5eb6-c38b-4029-a01b-2ef00c7deb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:57.267796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb5eb6-c38b-4029-a01b-2ef00c7deb03 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:57.268231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb5eb6-c38b-4029-a01b-2ef00c7deb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:57.268703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb5eb6-c38b-4029-a01b-2ef00c7deb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:57.269884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb5eb6-c38b-4029-a01b-2ef00c7deb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:57.276339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb5eb6-c38b-4029-a01b-2ef00c7deb03 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:57.295321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 853/1718] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:57.298635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad82f3-1801-48cc-8772-d84b1ceba47e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:57.310774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad82f3-1801-48cc-8772-d84b1ceba47e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:57.353885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8389a888-c04d-4f11-b2d9-106b30bcd6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:57.354641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389a888-c04d-4f11-b2d9-106b30bcd6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:57.354933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389a888-c04d-4f11-b2d9-106b30bcd6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:57.356019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8389a888-c04d-4f11-b2d9-106b30bcd6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:57.356966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389a888-c04d-4f11-b2d9-106b30bcd6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:57.358609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8389a888-c04d-4f11-b2d9-106b30bcd6b8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:57.444751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 866/1719] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:57.445428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb5eb6-c38b-4029-a01b-2ef00c7deb03 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:57.472959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb5eb6-c38b-4029-a01b-2ef00c7deb03 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:57.482043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa515b53-d5d1-43ff-8ddf-a11a1b69585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:57.483002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa515b53-d5d1-43ff-8ddf-a11a1b69585e admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:57.483322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa515b53-d5d1-43ff-8ddf-a11a1b69585e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:57.483895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa515b53-d5d1-43ff-8ddf-a11a1b69585e admin admin] PATH_INFO: `/v3/projects/cdacea1e06a94d4e8f31d6b45f3e44e2/users/df79f0000460472fb04a758225da6016/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:57.523758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa515b53-d5d1-43ff-8ddf-a11a1b69585e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdacea1e06a94d4e8f31d6b45f3e44e2, user_id=df79f0000460472fb04a758225da6016, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:57.530296 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa515b53-d5d1-43ff-8ddf-a11a1b69585e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:57.574635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 854/1720] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:57 2022] PUT /identity/v3/projects/cdacea1e06a94d4e8f31d6b45f3e44e2/users/df79f0000460472fb04a758225da6016/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:57.584095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29a2a1-d7aa-4d91-8eeb-627980da5edd None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:57.584675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29a2a1-d7aa-4d91-8eeb-627980da5edd None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:57.585134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29a2a1-d7aa-4d91-8eeb-627980da5edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:57.671085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8f29a2a1-d7aa-4d91-8eeb-627980da5edd None None] MFA Rules not processed for user `df79f0000460472fb04a758225da6016`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:57.672503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8f29a2a1-d7aa-4d91-8eeb-627980da5edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:57.869834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 867/1721] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:57.871592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa515b53-d5d1-43ff-8ddf-a11a1b69585e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:58.057919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa515b53-d5d1-43ff-8ddf-a11a1b69585e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:58.082509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1fe80-6696-4eac-8250-55acbf88147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:58.087016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1fe80-6696-4eac-8250-55acbf88147a admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:58.087292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1fe80-6696-4eac-8250-55acbf88147a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:58.087681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1fe80-6696-4eac-8250-55acbf88147a admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:58.091851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1fe80-6696-4eac-8250-55acbf88147a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:58.101206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1fe80-6696-4eac-8250-55acbf88147a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:58.173677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 855/1722] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:48:57 2022] POST /identity/v3/projects => generated 393 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:58.180977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29a2a1-d7aa-4d91-8eeb-627980da5edd None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:58.201260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29a2a1-d7aa-4d91-8eeb-627980da5edd None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:58.322685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d27867-71a0-4d8f-b0b8-7f23dedafe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:58.324879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d27867-71a0-4d8f-b0b8-7f23dedafe40 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:58.324879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d27867-71a0-4d8f-b0b8-7f23dedafe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:58.325100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d27867-71a0-4d8f-b0b8-7f23dedafe40 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:58.325825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d27867-71a0-4d8f-b0b8-7f23dedafe40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:58.328259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d27867-71a0-4d8f-b0b8-7f23dedafe40 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:58.385901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 868/1723] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:48:58 2022] POST /identity/v3/users => generated 303 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:48:58.389329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1fe80-6696-4eac-8250-55acbf88147a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:58.407848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1fe80-6696-4eac-8250-55acbf88147a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:58.435621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ad310-c2ed-468f-a1a8-5f18533eed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:58.438604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ad310-c2ed-468f-a1a8-5f18533eed26 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:58.438917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ad310-c2ed-468f-a1a8-5f18533eed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:58.439226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ad310-c2ed-468f-a1a8-5f18533eed26 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:58.446186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ad310-c2ed-468f-a1a8-5f18533eed26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:58.453278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53525d-aec4-4f32-ab79-c997ed996ef6 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:58.454413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ad310-c2ed-468f-a1a8-5f18533eed26 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:58.454918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53525d-aec4-4f32-ab79-c997ed996ef6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:58.455354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53525d-aec4-4f32-ab79-c997ed996ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:58.502409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-5d53525d-aec4-4f32-ab79-c997ed996ef6 None None] MFA Rules not processed for user `15ae418635734639a4d10676978e82cf`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:58.507616 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5d53525d-aec4-4f32-ab79-c997ed996ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:58.512145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 856/1724] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:58.514230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ad310-c2ed-468f-a1a8-5f18533eed26 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:58.523365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ed6ad310-c2ed-468f-a1a8-5f18533eed26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:58.561609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ad310-c2ed-468f-a1a8-5f18533eed26 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:58.581023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:58.582105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:58.582216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:58.582481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] PATH_INFO: `/v3/projects/07e2fd1d5cea4b53b8a8826e926b52fe` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:58.592300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e2fd1d5cea4b53b8a8826e926b52fe)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:58.608890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:58.734364 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 869/1725] 10.222.0.24 () {58 vars in 1015 bytes} [Thu Jan 27 16:48:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:58.736667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53525d-aec4-4f32-ab79-c997ed996ef6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:58.770598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e2fd1d5cea4b53b8a8826e926b52fe', 'request_id': 'req-205a3f06-b2fb-4b28-859f-f71e4434440d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:58.774056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53525d-aec4-4f32-ab79-c997ed996ef6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:58.789765 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e2fd1d5cea4b53b8a8826e926b52fe', 'request_id': 'req-205a3f06-b2fb-4b28-859f-f71e4434440d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:58.810719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e2fd1d5cea4b53b8a8826e926b52fe', 'request_id': 'req-205a3f06-b2fb-4b28-859f-f71e4434440d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:58.879016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] The token cache is being invalidate because project 07e2fd1d5cea4b53b8a8826e926b52fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:48:58.879315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:58.880347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-205a3f06-b2fb-4b28-859f-f71e4434440d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:48:58.882624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 857/1726] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:48:58 2022] DELETE /identity/v3/projects/07e2fd1d5cea4b53b8a8826e926b52fe => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:58.889530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cab4f-50d4-4813-a8e7-0876fd1a8552 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:58.889824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cab4f-50d4-4813-a8e7-0876fd1a8552 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:58.890336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8cab4f-50d4-4813-a8e7-0876fd1a8552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:58.937950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ee8cab4f-50d4-4813-a8e7-0876fd1a8552 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:58.940215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ee8cab4f-50d4-4813-a8e7-0876fd1a8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:58.974474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd70f-345f-43a2-942d-d6c862643647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:58.976626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd70f-345f-43a2-942d-d6c862643647 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:58.977003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd70f-345f-43a2-942d-d6c862643647 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:58.977318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd70f-345f-43a2-942d-d6c862643647 admin admin] PATH_INFO: `/v3/projects/3686272246e14fc9ab301eb0e7c49860/users/6c8d9276158040cca0f862c27a5d50ee/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:59.020327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbd70f-345f-43a2-942d-d6c862643647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3686272246e14fc9ab301eb0e7c49860, user_id=6c8d9276158040cca0f862c27a5d50ee, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:59.027591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fbd70f-345f-43a2-942d-d6c862643647 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:59.074348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 870/1727] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:58 2022] PUT /identity/v3/projects/3686272246e14fc9ab301eb0e7c49860/users/6c8d9276158040cca0f862c27a5d50ee/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:59.076102 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd70f-345f-43a2-942d-d6c862643647 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:59.082086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-89fbd70f-345f-43a2-942d-d6c862643647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:59.121757 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 858/1728] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:59.122631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cab4f-50d4-4813-a8e7-0876fd1a8552 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:59.127403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ee8cab4f-50d4-4813-a8e7-0876fd1a8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:59.260191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd70f-345f-43a2-942d-d6c862643647 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:59.273785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f6a39f-6135-433a-9827-1621fad67b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:59.274771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6a39f-6135-433a-9827-1621fad67b61 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:59.276731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6a39f-6135-433a-9827-1621fad67b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:59.277829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6a39f-6135-433a-9827-1621fad67b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:59.290439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6a39f-6135-433a-9827-1621fad67b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:59.296548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f6a39f-6135-433a-9827-1621fad67b61 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:59.361149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8cab4f-50d4-4813-a8e7-0876fd1a8552 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:59.371260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 871/1729] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:48:59.373684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6efc2-a2e7-4ff6-b2bc-1d42fddf8d39 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:59.376250 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6efc2-a2e7-4ff6-b2bc-1d42fddf8d39 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:59.376827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade6efc2-a2e7-4ff6-b2bc-1d42fddf8d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:59.438308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ade6efc2-a2e7-4ff6-b2bc-1d42fddf8d39 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:59.439750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ade6efc2-a2e7-4ff6-b2bc-1d42fddf8d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:59.502793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 872/1730] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:59.503767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6efc2-a2e7-4ff6-b2bc-1d42fddf8d39 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:59.557220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801de4ef-25d8-41c9-b2aa-dfa7370485ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:59.557908 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de4ef-25d8-41c9-b2aa-dfa7370485ee service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:59.558906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de4ef-25d8-41c9-b2aa-dfa7370485ee service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:59.559210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de4ef-25d8-41c9-b2aa-dfa7370485ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:59.561433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-801de4ef-25d8-41c9-b2aa-dfa7370485ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:59.586928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801de4ef-25d8-41c9-b2aa-dfa7370485ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:59.588831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801de4ef-25d8-41c9-b2aa-dfa7370485ee service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:59.628643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 859/1731] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:59.632005 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c9f49-c63b-4105-935e-b6962fa5a249 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:59.632304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c9f49-c63b-4105-935e-b6962fa5a249 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:59.632591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c9f49-c63b-4105-935e-b6962fa5a249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:59.656196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade6efc2-a2e7-4ff6-b2bc-1d42fddf8d39 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:59.688456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3aea-8216-415b-a9c8-74db0e32c25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:59.689364 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3aea-8216-415b-a9c8-74db0e32c25f service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:59.689814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3aea-8216-415b-a9c8-74db0e32c25f service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:59.690224 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d3aea-8216-415b-a9c8-74db0e32c25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:59.715858 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c24c9f49-c63b-4105-935e-b6962fa5a249 None None] MFA Rules not processed for user `c2c8a269081c42abae453a5be4772d50`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:59.717350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c24c9f49-c63b-4105-935e-b6962fa5a249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:48:59.724833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d3aea-8216-415b-a9c8-74db0e32c25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:59.726305 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d3aea-8216-415b-a9c8-74db0e32c25f service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:59.755986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 873/1732] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:48:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:48:59.756784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3aea-8216-415b-a9c8-74db0e32c25f service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:59.801050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d3aea-8216-415b-a9c8-74db0e32c25f service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:48:59.812902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1b282-1c23-4e94-a103-9d3bdd27d965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:48:59.813916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1b282-1c23-4e94-a103-9d3bdd27d965 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:59.814082 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1b282-1c23-4e94-a103-9d3bdd27d965 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:59.814399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1b282-1c23-4e94-a103-9d3bdd27d965 admin admin] PATH_INFO: `/v3/projects/3686272246e14fc9ab301eb0e7c49860/users/6c8d9276158040cca0f862c27a5d50ee/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:59.829124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1b282-1c23-4e94-a103-9d3bdd27d965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3686272246e14fc9ab301eb0e7c49860, user_id=6c8d9276158040cca0f862c27a5d50ee, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:48:59.831683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1b282-1c23-4e94-a103-9d3bdd27d965 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:48:59.855437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 874/1733] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:48:59 2022] PUT /identity/v3/projects/3686272246e14fc9ab301eb0e7c49860/users/6c8d9276158040cca0f862c27a5d50ee/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:48:59.856858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1b282-1c23-4e94-a103-9d3bdd27d965 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:48:59.913647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 860/1734] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:48:59.915469 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eea95-bb91-4053-8333-3c1dfd28e323 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:48:59.916168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eea95-bb91-4053-8333-3c1dfd28e323 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:48:59.916701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37eea95-bb91-4053-8333-3c1dfd28e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:48:59.958026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b37eea95-bb91-4053-8333-3c1dfd28e323 None None] MFA Rules not processed for user `6c8d9276158040cca0f862c27a5d50ee`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:48:59.959745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b37eea95-bb91-4053-8333-3c1dfd28e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:00.070451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 861/1735] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:48:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:00.072579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0bcc-805e-4708-ab36-5004d176d055 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:00.073143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0bcc-805e-4708-ab36-5004d176d055 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:00.082507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0bcc-805e-4708-ab36-5004d176d055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:00.127675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e93a0bcc-805e-4708-ab36-5004d176d055 None None] MFA Rules not processed for user `c2c8a269081c42abae453a5be4772d50`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:00.130173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e93a0bcc-805e-4708-ab36-5004d176d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:00.144888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1b282-1c23-4e94-a103-9d3bdd27d965 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:00.155823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:00.157873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:00.158191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:00.158537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:00.159373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:00.159868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:00.161328 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:00.212806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 875/1736] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:49:00.216323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:00.221604 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:00.261217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 862/1737] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:00.262896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a048-04b7-4c46-9798-32748d3d5515 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:00.263199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a048-04b7-4c46-9798-32748d3d5515 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:00.263515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6a048-04b7-4c46-9798-32748d3d5515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:00.330189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1eb6a048-04b7-4c46-9798-32748d3d5515 None None] MFA Rules not processed for user `afaf7700714045e3b1c445341651b8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:00.332762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1eb6a048-04b7-4c46-9798-32748d3d5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:00.382011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32618d7d-8c40-45a5-b8e5-7255e0d2b25e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:00.385760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d63c20-6f30-4bf0-baa2-cb5b457f5a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:00.387251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d63c20-6f30-4bf0-baa2-cb5b457f5a47 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:00.387735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d63c20-6f30-4bf0-baa2-cb5b457f5a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:00.388073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d63c20-6f30-4bf0-baa2-cb5b457f5a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:00.403335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d63c20-6f30-4bf0-baa2-cb5b457f5a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:00.404913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d63c20-6f30-4bf0-baa2-cb5b457f5a47 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:00.418743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 876/1738] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:00.419919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d63c20-6f30-4bf0-baa2-cb5b457f5a47 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:00.432151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d63c20-6f30-4bf0-baa2-cb5b457f5a47 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:00.438118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f0d59-2b0f-4d20-9364-2f5e9d6a7f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:00.439136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f0d59-2b0f-4d20-9364-2f5e9d6a7f5b admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:00.440081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f0d59-2b0f-4d20-9364-2f5e9d6a7f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:00.440363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f0d59-2b0f-4d20-9364-2f5e9d6a7f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:00.443760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f0d59-2b0f-4d20-9364-2f5e9d6a7f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:00.449909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f0d59-2b0f-4d20-9364-2f5e9d6a7f5b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:00.519312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 863/1739] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:00.520531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a048-04b7-4c46-9798-32748d3d5515 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:00.528826 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1eb6a048-04b7-4c46-9798-32748d3d5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:00.541036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 877/1740] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:00 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:00.545543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f0d59-2b0f-4d20-9364-2f5e9d6a7f5b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:00.698495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f0d59-2b0f-4d20-9364-2f5e9d6a7f5b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:00.712558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728aa66-fca7-426f-8524-b8ec1efa6ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:00.720233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728aa66-fca7-426f-8524-b8ec1efa6ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:00.720974 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728aa66-fca7-426f-8524-b8ec1efa6ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:00.722045 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8728aa66-fca7-426f-8524-b8ec1efa6ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:00.724330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728aa66-fca7-426f-8524-b8ec1efa6ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:00.727148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8728aa66-fca7-426f-8524-b8ec1efa6ea7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:00.778281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 878/1741] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:00 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:00.780061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728aa66-fca7-426f-8524-b8ec1efa6ea7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:00.782059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8728aa66-fca7-426f-8524-b8ec1efa6ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:00.799822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6a048-04b7-4c46-9798-32748d3d5515 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:00.868840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8728aa66-fca7-426f-8524-b8ec1efa6ea7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:00.874565 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6c877-785f-4a1a-83d4-c0c29e114577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:00.875782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6c877-785f-4a1a-83d4-c0c29e114577 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:00.876270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6c877-785f-4a1a-83d4-c0c29e114577 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:00.876840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac6c877-785f-4a1a-83d4-c0c29e114577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:00.879460 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-aac6c877-785f-4a1a-83d4-c0c29e114577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:01.041188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6c877-785f-4a1a-83d4-c0c29e114577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:01.042754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac6c877-785f-4a1a-83d4-c0c29e114577 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:01.053080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b281d-86a6-42d2-9032-b5eacd5abe26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:01.053897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b281d-86a6-42d2-9032-b5eacd5abe26 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:01.056969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b281d-86a6-42d2-9032-b5eacd5abe26 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:01.057310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b281d-86a6-42d2-9032-b5eacd5abe26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:01.082497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 879/1742] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:01.083599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6c877-785f-4a1a-83d4-c0c29e114577 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:01.132681 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac6c877-785f-4a1a-83d4-c0c29e114577 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:01.151402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c61f2-bec1-451d-b381-9533e4fb0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:01.153184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c61f2-bec1-451d-b381-9533e4fb0aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:01.153504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c61f2-bec1-451d-b381-9533e4fb0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:01.153790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c61f2-bec1-451d-b381-9533e4fb0aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:01.157416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c61f2-bec1-451d-b381-9533e4fb0aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:01.160697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c61f2-bec1-451d-b381-9533e4fb0aa3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:01.185228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b281d-86a6-42d2-9032-b5eacd5abe26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:01.187859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b281d-86a6-42d2-9032-b5eacd5abe26 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:01.196295 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 880/1743] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:01.197468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c61f2-bec1-451d-b381-9533e4fb0aa3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:01.215269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 864/1744] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:01.240842 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c61f2-bec1-451d-b381-9533e4fb0aa3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:01.255608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f201abe-5ec8-42be-b9b8-7e9afb9d8f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:01.272987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f201abe-5ec8-42be-b9b8-7e9afb9d8f77 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:01.274610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f201abe-5ec8-42be-b9b8-7e9afb9d8f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:01.276148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f201abe-5ec8-42be-b9b8-7e9afb9d8f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:01.277142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f201abe-5ec8-42be-b9b8-7e9afb9d8f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:01.296392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f201abe-5ec8-42be-b9b8-7e9afb9d8f77 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:01.321934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 881/1745] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:01.325208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b281d-86a6-42d2-9032-b5eacd5abe26 service nova] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:01.345564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b281d-86a6-42d2-9032-b5eacd5abe26 service nova] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:01.358744 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdc9d3-cd6f-465d-86b1-fda06e0d2688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:01.359952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc9d3-cd6f-465d-86b1-fda06e0d2688 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:01.360152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc9d3-cd6f-465d-86b1-fda06e0d2688 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:01.360435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc9d3-cd6f-465d-86b1-fda06e0d2688 admin admin] PATH_INFO: `/v3/projects/715c8ff57bdc4c678d249dc8adcc20af/users/44dfb95d6b9146fabaf2a84e031502f4/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:01.406258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdc9d3-cd6f-465d-86b1-fda06e0d2688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715c8ff57bdc4c678d249dc8adcc20af, user_id=44dfb95d6b9146fabaf2a84e031502f4, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:01.420875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdc9d3-cd6f-465d-86b1-fda06e0d2688 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:01.476626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 865/1746] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:01 2022] PUT /identity/v3/projects/715c8ff57bdc4c678d249dc8adcc20af/users/44dfb95d6b9146fabaf2a84e031502f4/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:01.477966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0102-2266-4bce-8f2d-5766d8de20ee None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:01.477966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0102-2266-4bce-8f2d-5766d8de20ee None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:01.477966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c0102-2266-4bce-8f2d-5766d8de20ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:01.567916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-088c0102-2266-4bce-8f2d-5766d8de20ee None None] MFA Rules not processed for user `44dfb95d6b9146fabaf2a84e031502f4`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:01.569179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-088c0102-2266-4bce-8f2d-5766d8de20ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:01.823694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 882/1747] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:01.824375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdc9d3-cd6f-465d-86b1-fda06e0d2688 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:01.948316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdc9d3-cd6f-465d-86b1-fda06e0d2688 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:01.963894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fd986-f56f-4b81-aa7a-78c7e7b4cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:01.966351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd986-f56f-4b81-aa7a-78c7e7b4cbcd admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:01.966941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd986-f56f-4b81-aa7a-78c7e7b4cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:01.967457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fd986-f56f-4b81-aa7a-78c7e7b4cbcd admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:01.968814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fd986-f56f-4b81-aa7a-78c7e7b4cbcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:01.971104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fd986-f56f-4b81-aa7a-78c7e7b4cbcd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:02.033181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0102-2266-4bce-8f2d-5766d8de20ee None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:02.035264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 866/1748] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:01 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:02.049739 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c0102-2266-4bce-8f2d-5766d8de20ee None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:02.189493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c3d66-2e6a-4cb7-ba76-9791b48de034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:02.190211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c3d66-2e6a-4cb7-ba76-9791b48de034 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:02.190502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c3d66-2e6a-4cb7-ba76-9791b48de034 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:02.190793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c3d66-2e6a-4cb7-ba76-9791b48de034 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:02.191523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c3d66-2e6a-4cb7-ba76-9791b48de034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:02.193533 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c3d66-2e6a-4cb7-ba76-9791b48de034 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:02.270838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 883/1749] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:02 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:02.272865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fd986-f56f-4b81-aa7a-78c7e7b4cbcd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:02.294144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fd986-f56f-4b81-aa7a-78c7e7b4cbcd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:02.313419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392bf9a-dd3b-416f-b71b-88cf79b729ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:02.314127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392bf9a-dd3b-416f-b71b-88cf79b729ce admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:02.314415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392bf9a-dd3b-416f-b71b-88cf79b729ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:02.314697 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392bf9a-dd3b-416f-b71b-88cf79b729ce admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:02.315455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392bf9a-dd3b-416f-b71b-88cf79b729ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:02.317271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392bf9a-dd3b-416f-b71b-88cf79b729ce admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:02.366777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 867/1750] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:02.371976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c3d66-2e6a-4cb7-ba76-9791b48de034 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:02.386758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c3d66-2e6a-4cb7-ba76-9791b48de034 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:02.402860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d23076-e581-4117-9ecd-e89dcfc49d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:02.403734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23076-e581-4117-9ecd-e89dcfc49d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:02.404030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23076-e581-4117-9ecd-e89dcfc49d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:02.404312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d23076-e581-4117-9ecd-e89dcfc49d2d admin admin] PATH_INFO: `/v3/projects/8e4cc7af7143480ea2b868be899b7fc2/users/ec98ab94866f4f5f9be233a7fbd2f00e/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:02.441109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d23076-e581-4117-9ecd-e89dcfc49d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4cc7af7143480ea2b868be899b7fc2, user_id=ec98ab94866f4f5f9be233a7fbd2f00e, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:02.443879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d23076-e581-4117-9ecd-e89dcfc49d2d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:02.467855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 884/1751] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:02 2022] PUT /identity/v3/projects/8e4cc7af7143480ea2b868be899b7fc2/users/ec98ab94866f4f5f9be233a7fbd2f00e/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:02.472574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392bf9a-dd3b-416f-b71b-88cf79b729ce admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:02.488735 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392bf9a-dd3b-416f-b71b-88cf79b729ce admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:02.622854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17156e96-5bc9-41a0-9eed-84d927347272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:02.623495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156e96-5bc9-41a0-9eed-84d927347272 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:02.623803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156e96-5bc9-41a0-9eed-84d927347272 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:02.624077 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156e96-5bc9-41a0-9eed-84d927347272 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:02.624825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17156e96-5bc9-41a0-9eed-84d927347272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:02.628639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17156e96-5bc9-41a0-9eed-84d927347272 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:02.655073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d23076-e581-4117-9ecd-e89dcfc49d2d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:02.655614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 868/1752] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:02.665678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d23076-e581-4117-9ecd-e89dcfc49d2d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:02.672062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1abac-83c9-4b1c-9a7c-a4488c9dd28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:02.673050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1abac-83c9-4b1c-9a7c-a4488c9dd28e admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:02.673414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1abac-83c9-4b1c-9a7c-a4488c9dd28e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:02.673908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1abac-83c9-4b1c-9a7c-a4488c9dd28e admin admin] PATH_INFO: `/v3/projects/8e4cc7af7143480ea2b868be899b7fc2/users/ec98ab94866f4f5f9be233a7fbd2f00e/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:02.676061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1abac-83c9-4b1c-9a7c-a4488c9dd28e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e4cc7af7143480ea2b868be899b7fc2, user_id=ec98ab94866f4f5f9be233a7fbd2f00e, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:02.679187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1abac-83c9-4b1c-9a7c-a4488c9dd28e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:02.695488 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 885/1753] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:02 2022] PUT /identity/v3/projects/8e4cc7af7143480ea2b868be899b7fc2/users/ec98ab94866f4f5f9be233a7fbd2f00e/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:02.708734 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c6941-cfe1-45b5-b9e2-5c99a0b54bd9 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:02.709090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c6941-cfe1-45b5-b9e2-5c99a0b54bd9 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:02.709430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c6941-cfe1-45b5-b9e2-5c99a0b54bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:02.769639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b95c6941-cfe1-45b5-b9e2-5c99a0b54bd9 None None] MFA Rules not processed for user `ec98ab94866f4f5f9be233a7fbd2f00e`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:02.770934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b95c6941-cfe1-45b5-b9e2-5c99a0b54bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:02.948153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 869/1754] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:02.958852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1abac-83c9-4b1c-9a7c-a4488c9dd28e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:03.065256 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1abac-83c9-4b1c-9a7c-a4488c9dd28e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:03.072551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f7c77-7852-408c-a79d-b3c9220c1fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:03.072551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f7c77-7852-408c-a79d-b3c9220c1fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:03.072551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f7c77-7852-408c-a79d-b3c9220c1fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:03.072551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f7c77-7852-408c-a79d-b3c9220c1fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:03.103033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f7c77-7852-408c-a79d-b3c9220c1fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:03.104256 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f7c77-7852-408c-a79d-b3c9220c1fc7 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:03.119478 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 886/1755] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:03.266802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c6941-cfe1-45b5-b9e2-5c99a0b54bd9 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:03.283794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c6941-cfe1-45b5-b9e2-5c99a0b54bd9 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:03.293659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ae85c-2822-4750-b7d1-edaf5740c288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:03.295883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae85c-2822-4750-b7d1-edaf5740c288 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:03.296250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae85c-2822-4750-b7d1-edaf5740c288 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:03.296533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ae85c-2822-4750-b7d1-edaf5740c288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:03.329924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af6c4-0a84-48af-b984-f718d6caa030 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:03.330559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af6c4-0a84-48af-b984-f718d6caa030 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:03.330982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7af6c4-0a84-48af-b984-f718d6caa030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:03.375968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ee7af6c4-0a84-48af-b984-f718d6caa030 None None] MFA Rules not processed for user `20137a83d3de4dcfaba05ab93c470829`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:03.377597 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ee7af6c4-0a84-48af-b984-f718d6caa030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:03.447745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ae85c-2822-4750-b7d1-edaf5740c288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:03.450057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ae85c-2822-4750-b7d1-edaf5740c288 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:03.464323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 870/1756] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:03.556998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 887/1757] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:03.558538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6322-fcf6-4340-be1e-5766e6fb1add None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:03.559037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6322-fcf6-4340-be1e-5766e6fb1add None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:03.559384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a6322-fcf6-4340-be1e-5766e6fb1add None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:03.563069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 871/1758] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jan 27 16:49:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:49:03.675277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37864200-8c7b-451a-91b5-6f71fb299fa2 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:03.675848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37864200-8c7b-451a-91b5-6f71fb299fa2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:03.676071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37864200-8c7b-451a-91b5-6f71fb299fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:03.737814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-37864200-8c7b-451a-91b5-6f71fb299fa2 None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:03.741044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-37864200-8c7b-451a-91b5-6f71fb299fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:03.906139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 888/1759] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jan 27 16:49:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:05.037471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a6322-fcf6-4340-be1e-5766e6fb1add None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:05.060836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a6322-fcf6-4340-be1e-5766e6fb1add None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:05.070157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da237c8-3d6d-4fd5-b174-dee31b192462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:05.071928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da237c8-3d6d-4fd5-b174-dee31b192462 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:05.072517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da237c8-3d6d-4fd5-b174-dee31b192462 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:05.072992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da237c8-3d6d-4fd5-b174-dee31b192462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:05.089923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da237c8-3d6d-4fd5-b174-dee31b192462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:05.094677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da237c8-3d6d-4fd5-b174-dee31b192462 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:05.118979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 872/1760] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:05.867985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37864200-8c7b-451a-91b5-6f71fb299fa2 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:05.985134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37864200-8c7b-451a-91b5-6f71fb299fa2 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:05.989865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:05.997318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:05.997785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:05.998083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] PATH_INFO: `/v3/users/df79f0000460472fb04a758225da6016` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:06.019370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df79f0000460472fb04a758225da6016)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:06.022694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:06.117209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aae42-8f2f-4f14-bad4-41b3624e09bf None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:06.118252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aae42-8f2f-4f14-bad4-41b3624e09bf None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:06.118896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9aae42-8f2f-4f14-bad4-41b3624e09bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:06.176589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df79f0000460472fb04a758225da6016'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:06.199807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df79f0000460472fb04a758225da6016'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:06.223229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1d9aae42-8f2f-4f14-bad4-41b3624e09bf None None] MFA Rules not processed for user `dd2a59a36a2e422795e977c7af5004e6`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:06.226497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1d9aae42-8f2f-4f14-bad4-41b3624e09bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:06.226898 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df79f0000460472fb04a758225da6016'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:06.242218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df79f0000460472fb04a758225da6016'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:06.243066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-84ead4c2-be35-4572-b767-20abb25dd718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df79f0000460472fb04a758225da6016'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:06.254841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 889/1761] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:05 2022] DELETE /identity/v3/users/df79f0000460472fb04a758225da6016 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:06.258918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662c4cc-7fee-49c4-9ec4-f507395a6a71 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:06.259217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662c4cc-7fee-49c4-9ec4-f507395a6a71 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:06.259500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662c4cc-7fee-49c4-9ec4-f507395a6a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:06.309793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2662c4cc-7fee-49c4-9ec4-f507395a6a71 None None] MFA Rules not processed for user `c2c8a269081c42abae453a5be4772d50`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:06.312133 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2662c4cc-7fee-49c4-9ec4-f507395a6a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:06.422935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 873/1762] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:06.426555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d93cc-9d73-4c37-a2d7-8146ad0a09d9 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:06.428190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d93cc-9d73-4c37-a2d7-8146ad0a09d9 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:06.428640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57d93cc-9d73-4c37-a2d7-8146ad0a09d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:06.451470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 890/1763] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:06.476310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b57d93cc-9d73-4c37-a2d7-8146ad0a09d9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:06.480814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b57d93cc-9d73-4c37-a2d7-8146ad0a09d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:06.569850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662c4cc-7fee-49c4-9ec4-f507395a6a71 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:06.571459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2662c4cc-7fee-49c4-9ec4-f507395a6a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:06.657106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 874/1764] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:06.671937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d93cc-9d73-4c37-a2d7-8146ad0a09d9 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:06.673595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b57d93cc-9d73-4c37-a2d7-8146ad0a09d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:06.747865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662c4cc-7fee-49c4-9ec4-f507395a6a71 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:06.763090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c8f69-1cc7-4a6c-845f-d3905c95b325 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:06.763919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c8f69-1cc7-4a6c-845f-d3905c95b325 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:06.764466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c8f69-1cc7-4a6c-845f-d3905c95b325 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:06.764745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c8f69-1cc7-4a6c-845f-d3905c95b325 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:06.809946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57d93cc-9d73-4c37-a2d7-8146ad0a09d9 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:06.823557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c1b5-180b-41b2-b90c-f5a7f839ea40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:06.825538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c1b5-180b-41b2-b90c-f5a7f839ea40 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:06.828418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c1b5-180b-41b2-b90c-f5a7f839ea40 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:06.828418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7c1b5-180b-41b2-b90c-f5a7f839ea40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:06.854098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7c1b5-180b-41b2-b90c-f5a7f839ea40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:06.856030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7c1b5-180b-41b2-b90c-f5a7f839ea40 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:06.893449 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 875/1765] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:49:06.904753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c8f69-1cc7-4a6c-845f-d3905c95b325 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:06.906994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c8f69-1cc7-4a6c-845f-d3905c95b325 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:06.929572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 891/1766] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:07.691586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c1b5-180b-41b2-b90c-f5a7f839ea40 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:07.693580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c0c7c1b5-180b-41b2-b90c-f5a7f839ea40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:07.722633 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7c1b5-180b-41b2-b90c-f5a7f839ea40 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:07.752413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:07.753303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:07.753591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:07.753869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] PATH_INFO: `/v3/projects/cdacea1e06a94d4e8f31d6b45f3e44e2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:07.756785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdacea1e06a94d4e8f31d6b45f3e44e2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:07.770257 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:07.857681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdacea1e06a94d4e8f31d6b45f3e44e2', 'request_id': 'req-14d2bd2e-ffc2-4603-908a-fe39f3c87391'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:07.869780 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdacea1e06a94d4e8f31d6b45f3e44e2', 'request_id': 'req-14d2bd2e-ffc2-4603-908a-fe39f3c87391'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:07.882071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdacea1e06a94d4e8f31d6b45f3e44e2', 'request_id': 'req-14d2bd2e-ffc2-4603-908a-fe39f3c87391'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:07.908152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] The token cache is being invalidate because project cdacea1e06a94d4e8f31d6b45f3e44e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:07.908555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:07.909444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:07.912742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 876/1767] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:07 2022] DELETE /identity/v3/projects/cdacea1e06a94d4e8f31d6b45f3e44e2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:07.916916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c8f69-1cc7-4a6c-845f-d3905c95b325 service nova] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:07.935726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c8f69-1cc7-4a6c-845f-d3905c95b325 service nova] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:08.059270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:08.060195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:08.060531 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:08.060808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] PATH_INFO: `/v3/users/6c8d9276158040cca0f862c27a5d50ee` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:08.062099 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8d9276158040cca0f862c27a5d50ee)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:08.065192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:08.178542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8d9276158040cca0f862c27a5d50ee'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.197546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8d9276158040cca0f862c27a5d50ee'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.216059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8d9276158040cca0f862c27a5d50ee'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.228790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8d9276158040cca0f862c27a5d50ee'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.229723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8d9276158040cca0f862c27a5d50ee'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.237741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 892/1768] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:07 2022] DELETE /identity/v3/users/6c8d9276158040cca0f862c27a5d50ee => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:08.587845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:08.590065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:08.617590 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2bd2e-ffc2-4603-908a-fe39f3c87391 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:08.749968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:08.752017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:08.752500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:08.753064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] PATH_INFO: `/v3/users/95d3b6fe91e347f5812ba1ab440647bc` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:08.754610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d3b6fe91e347f5812ba1ab440647bc)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:08.763526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:08.848604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d3b6fe91e347f5812ba1ab440647bc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.857531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d3b6fe91e347f5812ba1ab440647bc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.858516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d3b6fe91e347f5812ba1ab440647bc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.882706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d3b6fe91e347f5812ba1ab440647bc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.909487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d3b6fe91e347f5812ba1ab440647bc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:08.922575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 877/1769] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:08 2022] DELETE /identity/v3/users/95d3b6fe91e347f5812ba1ab440647bc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:09.430512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:09.432022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:09.467510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc16ebc-b019-4e66-b7b5-262adb647d55 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:09.538907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:09.540574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:09.632538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:09.634179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:09.634794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:09.635628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] PATH_INFO: `/v3/projects/3686272246e14fc9ab301eb0e7c49860` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:09.639011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3686272246e14fc9ab301eb0e7c49860)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:09.642250 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:09.656353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7167d42-357f-4f58-b7c1-f38bca29fe6a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:09.662401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:09.663866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:09.665040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:09.665587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] PATH_INFO: `/v3/projects/bc9ddf51191e4d33b866e3b1ee247655` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:09.667945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9ddf51191e4d33b866e3b1ee247655)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:09.670822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:09.711520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3686272246e14fc9ab301eb0e7c49860', 'request_id': 'req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.719354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3686272246e14fc9ab301eb0e7c49860', 'request_id': 'req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.726335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3686272246e14fc9ab301eb0e7c49860', 'request_id': 'req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.738804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9ddf51191e4d33b866e3b1ee247655', 'request_id': 'req-66377a0a-db1d-40b3-a02b-24a058baa7bc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.743119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] The token cache is being invalidate because project 3686272246e14fc9ab301eb0e7c49860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:09.743837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.746742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ac5aef95-c82b-49ab-8a3c-05a44a2287a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.749107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 893/1770] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:09 2022] DELETE /identity/v3/projects/3686272246e14fc9ab301eb0e7c49860 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:09.754171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9ddf51191e4d33b866e3b1ee247655', 'request_id': 'req-66377a0a-db1d-40b3-a02b-24a058baa7bc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.757351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deaf40-fe19-405e-b3f3-48a78a0bf863 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:09.757652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deaf40-fe19-405e-b3f3-48a78a0bf863 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:09.758002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deaf40-fe19-405e-b3f3-48a78a0bf863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:09.763361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9ddf51191e4d33b866e3b1ee247655', 'request_id': 'req-66377a0a-db1d-40b3-a02b-24a058baa7bc'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.777005 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] The token cache is being invalidate because project bc9ddf51191e4d33b866e3b1ee247655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:09.777293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.778372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.780491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 878/1771] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:09 2022] DELETE /identity/v3/projects/bc9ddf51191e4d33b866e3b1ee247655 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:09.784365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:09.785616 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-79deaf40-fe19-405e-b3f3-48a78a0bf863 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:09.786427 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:09.788357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-79deaf40-fe19-405e-b3f3-48a78a0bf863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:09.884021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 894/1772] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:09.889326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66377a0a-db1d-40b3-a02b-24a058baa7bc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:09.896654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108cb32-72e0-4e82-9380-ee5d4e5dcfa6 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:09.897013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108cb32-72e0-4e82-9380-ee5d4e5dcfa6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:09.898621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108cb32-72e0-4e82-9380-ee5d4e5dcfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:09.899908 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:09.901264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:09.902481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:09.902946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] PATH_INFO: `/v3/users/afaf7700714045e3b1c445341651b8b7` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:09.904514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afaf7700714045e3b1c445341651b8b7)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:09.907200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:09.942539 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2108cb32-72e0-4e82-9380-ee5d4e5dcfa6 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:09.943839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2108cb32-72e0-4e82-9380-ee5d4e5dcfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:09.957546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 895/1773] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:09.961077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108cb32-72e0-4e82-9380-ee5d4e5dcfa6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:09.972924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108cb32-72e0-4e82-9380-ee5d4e5dcfa6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:09.982104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afaf7700714045e3b1c445341651b8b7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.983802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b488f0-055e-47d8-b660-3cb73bccea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:09.984687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b488f0-055e-47d8-b660-3cb73bccea89 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:09.985202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b488f0-055e-47d8-b660-3cb73bccea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:09.985661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b488f0-055e-47d8-b660-3cb73bccea89 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:09.986563 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b488f0-055e-47d8-b660-3cb73bccea89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:09.987066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b488f0-055e-47d8-b660-3cb73bccea89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:09.989259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b488f0-055e-47d8-b660-3cb73bccea89 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:09.990276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afaf7700714045e3b1c445341651b8b7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:09.991330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afaf7700714045e3b1c445341651b8b7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:10.005979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 896/1774] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:49:10.007058 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b488f0-055e-47d8-b660-3cb73bccea89 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:10.018090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afaf7700714045e3b1c445341651b8b7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:10.027017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b488f0-055e-47d8-b660-3cb73bccea89 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:10.027552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afaf7700714045e3b1c445341651b8b7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:10.033119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad393a-fc1e-4423-a3a7-5cd644062d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:10.033799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad393a-fc1e-4423-a3a7-5cd644062d11 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.034251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad393a-fc1e-4423-a3a7-5cd644062d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.034541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad393a-fc1e-4423-a3a7-5cd644062d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.037997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 879/1775] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:09 2022] DELETE /identity/v3/users/afaf7700714045e3b1c445341651b8b7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:10.038114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad393a-fc1e-4423-a3a7-5cd644062d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:10.038114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad393a-fc1e-4423-a3a7-5cd644062d11 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:10.067693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 897/1776] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:10 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:10.076749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:10.080829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:10.174089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4978f07-1d87-4f81-bc22-29eb1621bf6f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:10.235712 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f69b4-76df-495d-943f-3061db62e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:10.236956 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f69b4-76df-495d-943f-3061db62e9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.237428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f69b4-76df-495d-943f-3061db62e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.237903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f69b4-76df-495d-943f-3061db62e9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.238979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f69b4-76df-495d-943f-3061db62e9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:10.241280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f69b4-76df-495d-943f-3061db62e9f1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:10.268465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad393a-fc1e-4423-a3a7-5cd644062d11 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:10.272942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 880/1777] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:10 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:10.273083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e1ad393a-fc1e-4423-a3a7-5cd644062d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:10.274130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f69b4-76df-495d-943f-3061db62e9f1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:10.285856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f69b4-76df-495d-943f-3061db62e9f1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:10.293951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad393a-fc1e-4423-a3a7-5cd644062d11 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:10.294592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec8265-2c8f-4216-a94d-f7975c4ac574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:10.295392 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec8265-2c8f-4216-a94d-f7975c4ac574 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.295767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec8265-2c8f-4216-a94d-f7975c4ac574 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.296108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec8265-2c8f-4216-a94d-f7975c4ac574 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.297200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec8265-2c8f-4216-a94d-f7975c4ac574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:10.299051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec8265-2c8f-4216-a94d-f7975c4ac574 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:10.305939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:10.307300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.308822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.309385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] PATH_INFO: `/v3/projects/6539c4a1302e4f7cb740a68cc7f77010` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.311279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6539c4a1302e4f7cb740a68cc7f77010)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:10.314459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:10.316072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 881/1778] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:10.322586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec8265-2c8f-4216-a94d-f7975c4ac574 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:10.335321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec8265-2c8f-4216-a94d-f7975c4ac574 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:10.341175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec060a5d-14fb-4f6a-bb0b-cc442482700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:10.341924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec060a5d-14fb-4f6a-bb0b-cc442482700b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.342276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec060a5d-14fb-4f6a-bb0b-cc442482700b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.343812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec060a5d-14fb-4f6a-bb0b-cc442482700b admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.344709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec060a5d-14fb-4f6a-bb0b-cc442482700b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:10.346579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec060a5d-14fb-4f6a-bb0b-cc442482700b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:10.359126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 882/1779] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:10.360609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5d82-f726-4368-9e8f-ce26add97788 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.361045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5d82-f726-4368-9e8f-ce26add97788 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.361257 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f5d82-f726-4368-9e8f-ce26add97788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.393470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6539c4a1302e4f7cb740a68cc7f77010', 'request_id': 'req-01889f1a-16cd-4f18-a80a-f7863ac02258'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:10.400371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6539c4a1302e4f7cb740a68cc7f77010', 'request_id': 'req-01889f1a-16cd-4f18-a80a-f7863ac02258'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:10.407838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6539c4a1302e4f7cb740a68cc7f77010', 'request_id': 'req-01889f1a-16cd-4f18-a80a-f7863ac02258'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:10.408659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-fd7f5d82-f726-4368-9e8f-ce26add97788 None None] MFA Rules not processed for user `dd2a59a36a2e422795e977c7af5004e6`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:10.414132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-fd7f5d82-f726-4368-9e8f-ce26add97788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:10.446542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] The token cache is being invalidate because project 6539c4a1302e4f7cb740a68cc7f77010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:10.447712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:10.449762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:10.452851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 898/1780] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:10 2022] DELETE /identity/v3/projects/6539c4a1302e4f7cb740a68cc7f77010 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:10.454299 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:10.456214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:10.584122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 883/1781] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:10.584122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ad021-1906-4465-8e4d-fcd6aec8662f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.584122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ad021-1906-4465-8e4d-fcd6aec8662f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.584122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ad021-1906-4465-8e4d-fcd6aec8662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.609269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01889f1a-16cd-4f18-a80a-f7863ac02258 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:10.672504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-457ad021-1906-4465-8e4d-fcd6aec8662f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:10.673753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-457ad021-1906-4465-8e4d-fcd6aec8662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:10.675716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09a212-115c-4944-afb2-d203dd7bec05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:10.676754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a212-115c-4944-afb2-d203dd7bec05 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.677041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a212-115c-4944-afb2-d203dd7bec05 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.677322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a212-115c-4944-afb2-d203dd7bec05 admin admin] PATH_INFO: `/v3/projects/6584646e674b4971a46b22c596810796/users/36948615912442df88e3f4bf397050da/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.723938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 884/1782] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:10.725460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc78c-86f2-41b3-834b-3d7098970bc1 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.725759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc78c-86f2-41b3-834b-3d7098970bc1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.726046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326cc78c-86f2-41b3-834b-3d7098970bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.740174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09a212-115c-4944-afb2-d203dd7bec05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6584646e674b4971a46b22c596810796, user_id=36948615912442df88e3f4bf397050da, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:10.743497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09a212-115c-4944-afb2-d203dd7bec05 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:10.766490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 899/1783] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:10 2022] PUT /identity/v3/projects/6584646e674b4971a46b22c596810796/users/36948615912442df88e3f4bf397050da/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:10.779637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771701fe-1e29-4c1e-86a1-f4fb8f1d5efb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:10.780256 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771701fe-1e29-4c1e-86a1-f4fb8f1d5efb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:10.780739 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771701fe-1e29-4c1e-86a1-f4fb8f1d5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:10.811439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-326cc78c-86f2-41b3-834b-3d7098970bc1 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:10.815177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-326cc78c-86f2-41b3-834b-3d7098970bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:10.931097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-771701fe-1e29-4c1e-86a1-f4fb8f1d5efb None None] MFA Rules not processed for user `36948615912442df88e3f4bf397050da`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:10.938893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-771701fe-1e29-4c1e-86a1-f4fb8f1d5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:11.022268 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 885/1784] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:11.030620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc78c-86f2-41b3-834b-3d7098970bc1 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.053106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326cc78c-86f2-41b3-834b-3d7098970bc1 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.070345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be66436-ae3f-4853-a189-a39166128302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.071041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be66436-ae3f-4853-a189-a39166128302 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.071336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be66436-ae3f-4853-a189-a39166128302 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.071654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be66436-ae3f-4853-a189-a39166128302 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.072420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be66436-ae3f-4853-a189-a39166128302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:11.072735 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be66436-ae3f-4853-a189-a39166128302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.075123 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be66436-ae3f-4853-a189-a39166128302 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.115789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 886/1785] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:49:11.131723 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be66436-ae3f-4853-a189-a39166128302 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.169953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be66436-ae3f-4853-a189-a39166128302 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.202752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c51e5f-9c3c-4b0e-932d-04b69921243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.203630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c51e5f-9c3c-4b0e-932d-04b69921243b admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.203932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c51e5f-9c3c-4b0e-932d-04b69921243b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.204216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c51e5f-9c3c-4b0e-932d-04b69921243b admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.204942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c51e5f-9c3c-4b0e-932d-04b69921243b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.206890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c51e5f-9c3c-4b0e-932d-04b69921243b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.243914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 900/1786] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:11.256698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771701fe-1e29-4c1e-86a1-f4fb8f1d5efb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.292566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771701fe-1e29-4c1e-86a1-f4fb8f1d5efb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.314986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 887/1787] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:11 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:11.315996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c51e5f-9c3c-4b0e-932d-04b69921243b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.316654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5ea7e-1c22-4dcd-99d4-a01f5f5245dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.320924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ea7e-1c22-4dcd-99d4-a01f5f5245dd admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.322172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ea7e-1c22-4dcd-99d4-a01f5f5245dd admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.324355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5ea7e-1c22-4dcd-99d4-a01f5f5245dd admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.337002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5ea7e-1c22-4dcd-99d4-a01f5f5245dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.345148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5ea7e-1c22-4dcd-99d4-a01f5f5245dd admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.431195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 901/1788] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:11 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:11.444291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c51e5f-9c3c-4b0e-932d-04b69921243b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.444957 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5ea7e-1c22-4dcd-99d4-a01f5f5245dd admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.598318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345283f-0703-4261-b6e0-046eb4a4a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.599218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345283f-0703-4261-b6e0-046eb4a4a7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.599621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345283f-0703-4261-b6e0-046eb4a4a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.609634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345283f-0703-4261-b6e0-046eb4a4a7b9 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.610632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345283f-0703-4261-b6e0-046eb4a4a7b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.612815 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345283f-0703-4261-b6e0-046eb4a4a7b9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.637702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5ea7e-1c22-4dcd-99d4-a01f5f5245dd admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.648320 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49366a0-5f90-48a8-86a0-7772eb726cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.653941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49366a0-5f90-48a8-86a0-7772eb726cff admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.654326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49366a0-5f90-48a8-86a0-7772eb726cff admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.654569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49366a0-5f90-48a8-86a0-7772eb726cff admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.659755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49366a0-5f90-48a8-86a0-7772eb726cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.668336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 888/1789] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:11 2022] POST /identity/v3/users => generated 288 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:11.672152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345283f-0703-4261-b6e0-046eb4a4a7b9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.679736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49366a0-5f90-48a8-86a0-7772eb726cff admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.686083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345283f-0703-4261-b6e0-046eb4a4a7b9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.699756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3556-3fe8-40a4-93c0-84da67c766ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.706388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3556-3fe8-40a4-93c0-84da67c766ac admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.707131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3556-3fe8-40a4-93c0-84da67c766ac admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.707659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a3556-3fe8-40a4-93c0-84da67c766ac admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.709130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a3556-3fe8-40a4-93c0-84da67c766ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.711270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a3556-3fe8-40a4-93c0-84da67c766ac admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.743117 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 889/1790] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:11.744667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 902/1791] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:11 2022] POST /identity/v3/users => generated 298 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:11.747781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3556-3fe8-40a4-93c0-84da67c766ac admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.750899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49366a0-5f90-48a8-86a0-7772eb726cff admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.770861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a3556-3fe8-40a4-93c0-84da67c766ac admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.790043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70271cd-9bb0-4aed-aca0-daed9d7bb44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.791122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70271cd-9bb0-4aed-aca0-daed9d7bb44c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.791630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70271cd-9bb0-4aed-aca0-daed9d7bb44c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.792817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70271cd-9bb0-4aed-aca0-daed9d7bb44c admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.794152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49366a0-5f90-48a8-86a0-7772eb726cff admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.794873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70271cd-9bb0-4aed-aca0-daed9d7bb44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.799353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70271cd-9bb0-4aed-aca0-daed9d7bb44c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.809219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e10821-3342-4234-a03f-e8dd03398f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.810243 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e10821-3342-4234-a03f-e8dd03398f5f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.810742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e10821-3342-4234-a03f-e8dd03398f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.812076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e10821-3342-4234-a03f-e8dd03398f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.821484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e10821-3342-4234-a03f-e8dd03398f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.827174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e10821-3342-4234-a03f-e8dd03398f5f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.832899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 890/1792] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:11.835438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70271cd-9bb0-4aed-aca0-daed9d7bb44c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.858724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70271cd-9bb0-4aed-aca0-daed9d7bb44c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.859544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 903/1793] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:11.865914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e10821-3342-4234-a03f-e8dd03398f5f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:11.875654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611081e-b54c-4ca8-88bb-6db39937d867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.877237 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611081e-b54c-4ca8-88bb-6db39937d867 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.877693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611081e-b54c-4ca8-88bb-6db39937d867 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.878150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611081e-b54c-4ca8-88bb-6db39937d867 admin admin] PATH_INFO: `/v3/projects/55033e40da5a48ada384102acbbc029b/users/50f28bb145bd408994b9e96b8b826dd3/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.894440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e10821-3342-4234-a03f-e8dd03398f5f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:11.907481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963d307-11c8-4e1b-a539-56ae5e196e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:11.908533 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d307-11c8-4e1b-a539-56ae5e196e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.908821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d307-11c8-4e1b-a539-56ae5e196e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.909106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8963d307-11c8-4e1b-a539-56ae5e196e5f admin admin] PATH_INFO: `/v3/projects/fff86ba087154ef8835cd1d0943e979a/users/795987fd10f34d9483c78fee3b595961/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.919237 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611081e-b54c-4ca8-88bb-6db39937d867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55033e40da5a48ada384102acbbc029b, user_id=50f28bb145bd408994b9e96b8b826dd3, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.922980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611081e-b54c-4ca8-88bb-6db39937d867 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.946668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963d307-11c8-4e1b-a539-56ae5e196e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff86ba087154ef8835cd1d0943e979a, user_id=795987fd10f34d9483c78fee3b595961, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:11.950126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8963d307-11c8-4e1b-a539-56ae5e196e5f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:11.959924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 891/1794] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:11 2022] PUT /identity/v3/projects/55033e40da5a48ada384102acbbc029b/users/50f28bb145bd408994b9e96b8b826dd3/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:11.971036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c80c16-e76e-407b-918e-040feaa7aac5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:11.971703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c80c16-e76e-407b-918e-040feaa7aac5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:11.972183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c80c16-e76e-407b-918e-040feaa7aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:11.982911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 904/1795] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:11 2022] PUT /identity/v3/projects/fff86ba087154ef8835cd1d0943e979a/users/795987fd10f34d9483c78fee3b595961/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:11.987818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963d307-11c8-4e1b-a539-56ae5e196e5f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:12.040613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d9c80c16-e76e-407b-918e-040feaa7aac5 None None] MFA Rules not processed for user `50f28bb145bd408994b9e96b8b826dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:12.043049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d9c80c16-e76e-407b-918e-040feaa7aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:12.138796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8963d307-11c8-4e1b-a539-56ae5e196e5f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:12.152567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653cde0-66ec-48d6-b550-b6ba732c44a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:12.153756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653cde0-66ec-48d6-b550-b6ba732c44a0 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.154438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653cde0-66ec-48d6-b550-b6ba732c44a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.154954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653cde0-66ec-48d6-b550-b6ba732c44a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.156461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653cde0-66ec-48d6-b550-b6ba732c44a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:12.164026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653cde0-66ec-48d6-b550-b6ba732c44a0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:12.190993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 905/1796] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:49:12.194680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653cde0-66ec-48d6-b550-b6ba732c44a0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:12.226460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 892/1797] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:12.231159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c80c16-e76e-407b-918e-040feaa7aac5 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:12.240287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653cde0-66ec-48d6-b550-b6ba732c44a0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:12.248988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c80c16-e76e-407b-918e-040feaa7aac5 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:12.250409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61211a6a-10e5-4c06-9d10-54eca94a92e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:12.250965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61211a6a-10e5-4c06-9d10-54eca94a92e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.251248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61211a6a-10e5-4c06-9d10-54eca94a92e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.251524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61211a6a-10e5-4c06-9d10-54eca94a92e0 admin admin] PATH_INFO: `/v3/projects/fff86ba087154ef8835cd1d0943e979a/users/795987fd10f34d9483c78fee3b595961/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.256145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9005-1c2f-4d17-b4bf-05ae9d7eb0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:12.257103 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9005-1c2f-4d17-b4bf-05ae9d7eb0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.257593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9005-1c2f-4d17-b4bf-05ae9d7eb0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.258077 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb9005-1c2f-4d17-b4bf-05ae9d7eb0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.259057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9005-1c2f-4d17-b4bf-05ae9d7eb0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:12.259304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61211a6a-10e5-4c06-9d10-54eca94a92e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff86ba087154ef8835cd1d0943e979a, user_id=795987fd10f34d9483c78fee3b595961, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:12.262094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb9005-1c2f-4d17-b4bf-05ae9d7eb0c1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:12.262548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61211a6a-10e5-4c06-9d10-54eca94a92e0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:12.288659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 906/1798] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:12 2022] PUT /identity/v3/projects/fff86ba087154ef8835cd1d0943e979a/users/795987fd10f34d9483c78fee3b595961/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:12.299451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b97f2-bd93-4fb1-b69f-5752f5f4b89e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.300158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b97f2-bd93-4fb1-b69f-5752f5f4b89e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.300442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b97f2-bd93-4fb1-b69f-5752f5f4b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.343423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 893/1799] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:12 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:12.345674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9005-1c2f-4d17-b4bf-05ae9d7eb0c1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:12.359374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-4a1b97f2-bd93-4fb1-b69f-5752f5f4b89e None None] MFA Rules not processed for user `795987fd10f34d9483c78fee3b595961`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:12.361073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4a1b97f2-bd93-4fb1-b69f-5752f5f4b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:12.471947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 907/1800] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:12.489940 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b97f2-bd93-4fb1-b69f-5752f5f4b89e None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:12.496315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4a1b97f2-bd93-4fb1-b69f-5752f5f4b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:12.542569 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb9005-1c2f-4d17-b4bf-05ae9d7eb0c1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:12.559150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3870f62-12d6-4ec5-a767-b07cd6650abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:12.560301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3870f62-12d6-4ec5-a767-b07cd6650abf admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.560301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3870f62-12d6-4ec5-a767-b07cd6650abf admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.560518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3870f62-12d6-4ec5-a767-b07cd6650abf admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.561174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3870f62-12d6-4ec5-a767-b07cd6650abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:12.566845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3870f62-12d6-4ec5-a767-b07cd6650abf admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:12.587540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b97f2-bd93-4fb1-b69f-5752f5f4b89e None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:12.593842 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88605140-f20f-4b6f-aee7-ca52290efbd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:12.595359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88605140-f20f-4b6f-aee7-ca52290efbd4 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.597368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88605140-f20f-4b6f-aee7-ca52290efbd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.597786 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88605140-f20f-4b6f-aee7-ca52290efbd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.617350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 894/1801] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:12 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:12.622155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3870f62-12d6-4ec5-a767-b07cd6650abf admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:12.653395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3870f62-12d6-4ec5-a767-b07cd6650abf admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:12.665905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239607f7-4b47-4253-a5be-0ad65ba04f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:12.666646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239607f7-4b47-4253-a5be-0ad65ba04f41 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.670263 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239607f7-4b47-4253-a5be-0ad65ba04f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.670566 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239607f7-4b47-4253-a5be-0ad65ba04f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.672429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239607f7-4b47-4253-a5be-0ad65ba04f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:12.675426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239607f7-4b47-4253-a5be-0ad65ba04f41 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:12.703170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 895/1802] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:12.710052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239607f7-4b47-4253-a5be-0ad65ba04f41 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:12.729749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239607f7-4b47-4253-a5be-0ad65ba04f41 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:12.739093 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1857e68-bf80-4643-b981-ce8db6b46b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:12.740611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1857e68-bf80-4643-b981-ce8db6b46b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.740611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1857e68-bf80-4643-b981-ce8db6b46b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.740611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1857e68-bf80-4643-b981-ce8db6b46b16 admin admin] PATH_INFO: `/v3/projects/66c4e341476145bfbca51547620639d8/users/55929c61f4154ba19206ecd2c9683b08/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.747041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88605140-f20f-4b6f-aee7-ca52290efbd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:12.748753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88605140-f20f-4b6f-aee7-ca52290efbd4 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:12.761051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1857e68-bf80-4643-b981-ce8db6b46b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c4e341476145bfbca51547620639d8, user_id=55929c61f4154ba19206ecd2c9683b08, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:12.765355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1857e68-bf80-4643-b981-ce8db6b46b16 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:12.771825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 908/1803] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:12.786930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 896/1804] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:12 2022] PUT /identity/v3/projects/66c4e341476145bfbca51547620639d8/users/55929c61f4154ba19206ecd2c9683b08/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:12.788010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88605140-f20f-4b6f-aee7-ca52290efbd4 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:12.800108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88605140-f20f-4b6f-aee7-ca52290efbd4 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:12.894212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fea870-0c12-4afc-8251-22fc5102b156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:12.895421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fea870-0c12-4afc-8251-22fc5102b156 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.895744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fea870-0c12-4afc-8251-22fc5102b156 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.896026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fea870-0c12-4afc-8251-22fc5102b156 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.897319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fea870-0c12-4afc-8251-22fc5102b156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:12.898651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fea870-0c12-4afc-8251-22fc5102b156 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:12.913791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 909/1805] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:12.918450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1857e68-bf80-4643-b981-ce8db6b46b16 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:12.929301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1857e68-bf80-4643-b981-ce8db6b46b16 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:12.936537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765229f-a7cc-43b9-810e-1deda7446ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:12.937836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765229f-a7cc-43b9-810e-1deda7446ff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.938264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765229f-a7cc-43b9-810e-1deda7446ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.938906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765229f-a7cc-43b9-810e-1deda7446ff4 admin admin] PATH_INFO: `/v3/projects/66c4e341476145bfbca51547620639d8/users/55929c61f4154ba19206ecd2c9683b08/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:12.941561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765229f-a7cc-43b9-810e-1deda7446ff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c4e341476145bfbca51547620639d8, user_id=55929c61f4154ba19206ecd2c9683b08, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:12.944779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765229f-a7cc-43b9-810e-1deda7446ff4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:12.967176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 897/1806] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:12 2022] PUT /identity/v3/projects/66c4e341476145bfbca51547620639d8/users/55929c61f4154ba19206ecd2c9683b08/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:12.969459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5656a-86f6-4d89-8d2b-39849d3f443a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:12.970360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5656a-86f6-4d89-8d2b-39849d3f443a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:12.970360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec5656a-86f6-4d89-8d2b-39849d3f443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:13.010137 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-dec5656a-86f6-4d89-8d2b-39849d3f443a None None] MFA Rules not processed for user `55929c61f4154ba19206ecd2c9683b08`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:13.011558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-dec5656a-86f6-4d89-8d2b-39849d3f443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:13.158353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 910/1807] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:13.168877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765229f-a7cc-43b9-810e-1deda7446ff4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:13.316453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765229f-a7cc-43b9-810e-1deda7446ff4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:13.320442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b1152-15c3-4465-8318-86f2c86f2a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:13.321082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b1152-15c3-4465-8318-86f2c86f2a0a service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:13.321369 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b1152-15c3-4465-8318-86f2c86f2a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:13.321650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b1152-15c3-4465-8318-86f2c86f2a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:13.439486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b1152-15c3-4465-8318-86f2c86f2a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:13.442499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b1152-15c3-4465-8318-86f2c86f2a0a service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:13.467205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 898/1808] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:13.768351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5656a-86f6-4d89-8d2b-39849d3f443a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:13.770479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-dec5656a-86f6-4d89-8d2b-39849d3f443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:13.853649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec5656a-86f6-4d89-8d2b-39849d3f443a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:13.860508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:13.861393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:13.862044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:13.862044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] PATH_INFO: `/v3/users/44dfb95d6b9146fabaf2a84e031502f4` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:13.864635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] RBAC: Authorizing `identity:delete_user(user_id=44dfb95d6b9146fabaf2a84e031502f4)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:13.866599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:13.969235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44dfb95d6b9146fabaf2a84e031502f4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:13.985387 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44dfb95d6b9146fabaf2a84e031502f4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:14.003898 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44dfb95d6b9146fabaf2a84e031502f4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:14.013057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44dfb95d6b9146fabaf2a84e031502f4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:14.013831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44dfb95d6b9146fabaf2a84e031502f4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:14.021362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 911/1809] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:13 2022] DELETE /identity/v3/users/44dfb95d6b9146fabaf2a84e031502f4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:14.025955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e7fd-d718-4d01-804d-6e0af48f1985 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:14.027087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e7fd-d718-4d01-804d-6e0af48f1985 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:14.027332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67e7fd-d718-4d01-804d-6e0af48f1985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:14.047136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2e67e7fd-d718-4d01-804d-6e0af48f1985 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:14.048592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2e67e7fd-d718-4d01-804d-6e0af48f1985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:14.119637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 899/1810] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:14.128418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:14.130057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:14.243504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4f42e-bf76-4889-bfc8-bf5598c7006f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:14.258257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43cc187-e984-4125-a467-09f30fb41ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:14.259487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cc187-e984-4125-a467-09f30fb41ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:14.259487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cc187-e984-4125-a467-09f30fb41ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:14.259984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43cc187-e984-4125-a467-09f30fb41ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:14.275958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cc187-e984-4125-a467-09f30fb41ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:14.277859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43cc187-e984-4125-a467-09f30fb41ad8 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:14.296076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 912/1811] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:14.834588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1960d-1093-4edd-897a-8aceadcafbf2 None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:14.835055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1960d-1093-4edd-897a-8aceadcafbf2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:14.835504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1960d-1093-4edd-897a-8aceadcafbf2 None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:14.837810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 900/1812] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jan 27 16:49:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:49:14.896261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515478e-2143-40a8-a602-f473c2361799 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:14.896713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515478e-2143-40a8-a602-f473c2361799 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:14.896713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515478e-2143-40a8-a602-f473c2361799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:14.938112 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7515478e-2143-40a8-a602-f473c2361799 None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:14.940069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7515478e-2143-40a8-a602-f473c2361799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:15.077098 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 913/1813] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jan 27 16:49:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:15.317115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1960d-1093-4edd-897a-8aceadcafbf2 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:15.319492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ccb1960d-1093-4edd-897a-8aceadcafbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:15.347436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1960d-1093-4edd-897a-8aceadcafbf2 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:15.359717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55666-6d71-4f26-82ab-7adefdf3a7d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:15.361647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55666-6d71-4f26-82ab-7adefdf3a7d7 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:15.362898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55666-6d71-4f26-82ab-7adefdf3a7d7 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:15.363639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf55666-6d71-4f26-82ab-7adefdf3a7d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:15.383779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55666-6d71-4f26-82ab-7adefdf3a7d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:15.386665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf55666-6d71-4f26-82ab-7adefdf3a7d7 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:15.412048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 901/1814] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:15.671510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515478e-2143-40a8-a602-f473c2361799 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:15.673279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7515478e-2143-40a8-a602-f473c2361799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:15.692427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515478e-2143-40a8-a602-f473c2361799 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:15.698245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:15.699258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:15.699840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:15.700405 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] PATH_INFO: `/v3/projects/715c8ff57bdc4c678d249dc8adcc20af` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:15.701675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=715c8ff57bdc4c678d249dc8adcc20af)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:15.718862 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:15.809657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715c8ff57bdc4c678d249dc8adcc20af', 'request_id': 'req-f24a4862-b95a-41e1-ba4e-001954181e7d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:15.816577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715c8ff57bdc4c678d249dc8adcc20af', 'request_id': 'req-f24a4862-b95a-41e1-ba4e-001954181e7d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:15.828140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715c8ff57bdc4c678d249dc8adcc20af', 'request_id': 'req-f24a4862-b95a-41e1-ba4e-001954181e7d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:15.847867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] The token cache is being invalidate because project 715c8ff57bdc4c678d249dc8adcc20af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:15.848620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:15.849867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:15.851700 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 914/1815] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:15 2022] DELETE /identity/v3/projects/715c8ff57bdc4c678d249dc8adcc20af => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:15.856153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55666-6d71-4f26-82ab-7adefdf3a7d7 service nova] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:15.871306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf55666-6d71-4f26-82ab-7adefdf3a7d7 service nova] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:15.957951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:15.959193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:15.959820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:15.960105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] PATH_INFO: `/v3/users/ec98ab94866f4f5f9be233a7fbd2f00e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:15.961530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec98ab94866f4f5f9be233a7fbd2f00e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:15.964912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:16.048211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec98ab94866f4f5f9be233a7fbd2f00e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:16.066816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec98ab94866f4f5f9be233a7fbd2f00e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:16.067764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec98ab94866f4f5f9be233a7fbd2f00e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:16.082441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec98ab94866f4f5f9be233a7fbd2f00e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:16.093684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-98b02aa6-dd50-40d2-a301-f6aad0493b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec98ab94866f4f5f9be233a7fbd2f00e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:16.108521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 902/1816] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:15 2022] DELETE /identity/v3/users/ec98ab94866f4f5f9be233a7fbd2f00e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:17.073855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:17.075268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:17.087956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a4862-b95a-41e1-ba4e-001954181e7d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:17.149066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:17.150191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.150474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.150751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] PATH_INFO: `/v3/projects/8e4cc7af7143480ea2b868be899b7fc2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.152286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e4cc7af7143480ea2b868be899b7fc2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:17.154208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:17.203437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e4cc7af7143480ea2b868be899b7fc2', 'request_id': 'req-044aea86-578d-43e0-9487-7f61b9ec9b24'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:17.210123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e4cc7af7143480ea2b868be899b7fc2', 'request_id': 'req-044aea86-578d-43e0-9487-7f61b9ec9b24'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:17.216188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e4cc7af7143480ea2b868be899b7fc2', 'request_id': 'req-044aea86-578d-43e0-9487-7f61b9ec9b24'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:17.228292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] The token cache is being invalidate because project 8e4cc7af7143480ea2b868be899b7fc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:17.228595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:17.229898 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-044aea86-578d-43e0-9487-7f61b9ec9b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:17.231540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 915/1817] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:17 2022] DELETE /identity/v3/projects/8e4cc7af7143480ea2b868be899b7fc2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:17.237302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab331ceb-afa8-4f42-b98b-4dd8729d1f21 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.237762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab331ceb-afa8-4f42-b98b-4dd8729d1f21 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.237877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab331ceb-afa8-4f42-b98b-4dd8729d1f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.261543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ab331ceb-afa8-4f42-b98b-4dd8729d1f21 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:17.262994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ab331ceb-afa8-4f42-b98b-4dd8729d1f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:17.321784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 903/1818] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:17.329792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d11c8-9833-4c9d-b427-4c6509a478b6 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.330125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d11c8-9833-4c9d-b427-4c6509a478b6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.330392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d11c8-9833-4c9d-b427-4c6509a478b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.349261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3d3d11c8-9833-4c9d-b427-4c6509a478b6 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:17.350465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3d3d11c8-9833-4c9d-b427-4c6509a478b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:17.359182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 916/1819] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:17.363334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab331ceb-afa8-4f42-b98b-4dd8729d1f21 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:17.373624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab331ceb-afa8-4f42-b98b-4dd8729d1f21 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:17.378436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15ac54-cee9-402e-a4c2-e5228042a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:17.379104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15ac54-cee9-402e-a4c2-e5228042a9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.379383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15ac54-cee9-402e-a4c2-e5228042a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.379921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15ac54-cee9-402e-a4c2-e5228042a9d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.380673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15ac54-cee9-402e-a4c2-e5228042a9d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:17.380984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15ac54-cee9-402e-a4c2-e5228042a9d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:17.382593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15ac54-cee9-402e-a4c2-e5228042a9d9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:17.397822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 904/1820] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:49:17.403116 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d11c8-9833-4c9d-b427-4c6509a478b6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:17.412226 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d11c8-9833-4c9d-b427-4c6509a478b6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:17.418062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdcce8-85ca-4d8c-aa08-4d288be4db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:17.418769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdcce8-85ca-4d8c-aa08-4d288be4db7d admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.419059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdcce8-85ca-4d8c-aa08-4d288be4db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.419344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdcce8-85ca-4d8c-aa08-4d288be4db7d admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.420128 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdcce8-85ca-4d8c-aa08-4d288be4db7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:17.422428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdcce8-85ca-4d8c-aa08-4d288be4db7d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:17.455879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 917/1821] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:17 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:17.461215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15ac54-cee9-402e-a4c2-e5228042a9d9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:17.473534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15ac54-cee9-402e-a4c2-e5228042a9d9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:17.533553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5fe09-c99e-4971-bc26-937b1b3eaeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:17.534238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5fe09-c99e-4971-bc26-937b1b3eaeee admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.534526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5fe09-c99e-4971-bc26-937b1b3eaeee admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.534804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5fe09-c99e-4971-bc26-937b1b3eaeee admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.535550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5fe09-c99e-4971-bc26-937b1b3eaeee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:17.537530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5fe09-c99e-4971-bc26-937b1b3eaeee admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:17.560088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 905/1822] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:17 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:17.564221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdcce8-85ca-4d8c-aa08-4d288be4db7d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:17.577044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdcce8-85ca-4d8c-aa08-4d288be4db7d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:17.582408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace83f55-f201-49f3-9799-d7893ce71159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:17.583330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83f55-f201-49f3-9799-d7893ce71159 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.583709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83f55-f201-49f3-9799-d7893ce71159 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.584077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace83f55-f201-49f3-9799-d7893ce71159 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.585025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace83f55-f201-49f3-9799-d7893ce71159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:17.586819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace83f55-f201-49f3-9799-d7893ce71159 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:17.601882 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 918/1823] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:17.603627 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5fe09-c99e-4971-bc26-937b1b3eaeee admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:17.614015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5fe09-c99e-4971-bc26-937b1b3eaeee admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:17.618640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31663718-e3ff-4475-b2ba-83b0bd8198d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:17.619401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31663718-e3ff-4475-b2ba-83b0bd8198d2 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.619767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31663718-e3ff-4475-b2ba-83b0bd8198d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.620070 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31663718-e3ff-4475-b2ba-83b0bd8198d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.620957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31663718-e3ff-4475-b2ba-83b0bd8198d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:17.622571 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31663718-e3ff-4475-b2ba-83b0bd8198d2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:17.632415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 906/1824] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:17.637337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace83f55-f201-49f3-9799-d7893ce71159 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:17.647113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace83f55-f201-49f3-9799-d7893ce71159 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:17.652248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d543e-716b-46a0-82d6-9f6984f8a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:17.653049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d543e-716b-46a0-82d6-9f6984f8a74c admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.653341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d543e-716b-46a0-82d6-9f6984f8a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.653625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d543e-716b-46a0-82d6-9f6984f8a74c admin admin] PATH_INFO: `/v3/projects/6a479cf2c2404472bf23265df57c3a56/users/b6571839cd1c4fc9873c4bd016208d67/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.668823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d543e-716b-46a0-82d6-9f6984f8a74c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a479cf2c2404472bf23265df57c3a56, user_id=b6571839cd1c4fc9873c4bd016208d67, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:17.671491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d543e-716b-46a0-82d6-9f6984f8a74c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:17.695668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 919/1825] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:17 2022] PUT /identity/v3/projects/6a479cf2c2404472bf23265df57c3a56/users/b6571839cd1c4fc9873c4bd016208d67/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:17.699512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe7cd2-a862-41c6-8ec8-6a1b067a215e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.699840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe7cd2-a862-41c6-8ec8-6a1b067a215e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.700124 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe7cd2-a862-41c6-8ec8-6a1b067a215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.730251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-bcbe7cd2-a862-41c6-8ec8-6a1b067a215e None None] MFA Rules not processed for user `b6571839cd1c4fc9873c4bd016208d67`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:17.731823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-bcbe7cd2-a862-41c6-8ec8-6a1b067a215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:17.796218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 907/1826] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:17.800758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d543e-716b-46a0-82d6-9f6984f8a74c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:17.860011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d543e-716b-46a0-82d6-9f6984f8a74c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:17.864584 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9974b0e-e2c5-4242-b17b-161f5b331c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:17.865246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9974b0e-e2c5-4242-b17b-161f5b331c33 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.865531 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9974b0e-e2c5-4242-b17b-161f5b331c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.865813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9974b0e-e2c5-4242-b17b-161f5b331c33 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.866524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9974b0e-e2c5-4242-b17b-161f5b331c33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:17.868465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9974b0e-e2c5-4242-b17b-161f5b331c33 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:17.895650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 920/1827] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:17 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:17.900346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe7cd2-a862-41c6-8ec8-6a1b067a215e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:17.912173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe7cd2-a862-41c6-8ec8-6a1b067a215e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:17.968549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c113f-46e3-42c4-b423-0f77a5d81252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:17.969152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c113f-46e3-42c4-b423-0f77a5d81252 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:17.969439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c113f-46e3-42c4-b423-0f77a5d81252 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:17.969723 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c113f-46e3-42c4-b423-0f77a5d81252 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:17.970443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c113f-46e3-42c4-b423-0f77a5d81252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:17.972419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c113f-46e3-42c4-b423-0f77a5d81252 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:17.991055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 908/1828] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:17 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:17.995701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9974b0e-e2c5-4242-b17b-161f5b331c33 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:18.006035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9974b0e-e2c5-4242-b17b-161f5b331c33 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:18.010951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e46c3-2a31-4a76-9312-43caade8922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:18.011643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e46c3-2a31-4a76-9312-43caade8922f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:18.011943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e46c3-2a31-4a76-9312-43caade8922f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:18.012222 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e46c3-2a31-4a76-9312-43caade8922f admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:18.012961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e46c3-2a31-4a76-9312-43caade8922f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:18.014559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e46c3-2a31-4a76-9312-43caade8922f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:18.025482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 921/1829] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:18.029766 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c113f-46e3-42c4-b423-0f77a5d81252 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:18.039808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c113f-46e3-42c4-b423-0f77a5d81252 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:18.044533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46ef3c-c8f8-4024-839f-b9cf6604cb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:18.045409 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46ef3c-c8f8-4024-839f-b9cf6604cb07 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:18.045694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46ef3c-c8f8-4024-839f-b9cf6604cb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:18.045966 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46ef3c-c8f8-4024-839f-b9cf6604cb07 admin admin] PATH_INFO: `/v3/projects/e3b4ade8ab47473c9cf2abaa955c10b6/users/859033bcb8554e8dabafeacb484e9f0b/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:18.063083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46ef3c-c8f8-4024-839f-b9cf6604cb07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b4ade8ab47473c9cf2abaa955c10b6, user_id=859033bcb8554e8dabafeacb484e9f0b, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:18.065806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46ef3c-c8f8-4024-839f-b9cf6604cb07 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:18.083941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 909/1830] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:18 2022] PUT /identity/v3/projects/e3b4ade8ab47473c9cf2abaa955c10b6/users/859033bcb8554e8dabafeacb484e9f0b/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:18.086124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e46c3-2a31-4a76-9312-43caade8922f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:18.097164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e46c3-2a31-4a76-9312-43caade8922f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:18.155252 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30633c09-b691-40ad-b666-bc71bf3eacb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:18.155973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633c09-b691-40ad-b666-bc71bf3eacb4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:18.156264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633c09-b691-40ad-b666-bc71bf3eacb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:18.156543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30633c09-b691-40ad-b666-bc71bf3eacb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:18.157289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30633c09-b691-40ad-b666-bc71bf3eacb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:18.158887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30633c09-b691-40ad-b666-bc71bf3eacb4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:18.172151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 922/1831] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:18.173305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46ef3c-c8f8-4024-839f-b9cf6604cb07 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:18.184742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46ef3c-c8f8-4024-839f-b9cf6604cb07 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:18.195607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e4d5c-4a39-4513-8cb2-5b53181cfce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:18.196518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e4d5c-4a39-4513-8cb2-5b53181cfce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:18.196926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e4d5c-4a39-4513-8cb2-5b53181cfce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:18.197436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e4d5c-4a39-4513-8cb2-5b53181cfce5 admin admin] PATH_INFO: `/v3/projects/e3b4ade8ab47473c9cf2abaa955c10b6/users/859033bcb8554e8dabafeacb484e9f0b/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:18.201008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e4d5c-4a39-4513-8cb2-5b53181cfce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b4ade8ab47473c9cf2abaa955c10b6, user_id=859033bcb8554e8dabafeacb484e9f0b, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:18.203730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e4d5c-4a39-4513-8cb2-5b53181cfce5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:18.223936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 910/1832] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:18 2022] PUT /identity/v3/projects/e3b4ade8ab47473c9cf2abaa955c10b6/users/859033bcb8554e8dabafeacb484e9f0b/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:18.234052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae5e0-e72f-48cb-89b9-ccfec5a4d9ca None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:18.234416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae5e0-e72f-48cb-89b9-ccfec5a4d9ca None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:18.234707 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aae5e0-e72f-48cb-89b9-ccfec5a4d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:18.262036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-18aae5e0-e72f-48cb-89b9-ccfec5a4d9ca None None] MFA Rules not processed for user `859033bcb8554e8dabafeacb484e9f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:18.263239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-18aae5e0-e72f-48cb-89b9-ccfec5a4d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:18.382288 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 923/1833] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:18.393965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e4d5c-4a39-4513-8cb2-5b53181cfce5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:18.396507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-075e4d5c-4a39-4513-8cb2-5b53181cfce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:18.486497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e4d5c-4a39-4513-8cb2-5b53181cfce5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:18.496800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def4875-c16a-4499-9831-3ea74d01543f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:18.497651 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def4875-c16a-4499-9831-3ea74d01543f service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:18.497942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def4875-c16a-4499-9831-3ea74d01543f service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:18.499273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def4875-c16a-4499-9831-3ea74d01543f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:18.517913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def4875-c16a-4499-9831-3ea74d01543f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:18.520617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def4875-c16a-4499-9831-3ea74d01543f service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:18.538389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 911/1834] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:18.652388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aae5e0-e72f-48cb-89b9-ccfec5a4d9ca None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:18.662274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aae5e0-e72f-48cb-89b9-ccfec5a4d9ca None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:18.667405 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abb7ee-cdb1-4e29-8da0-90ef0c5df990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:18.668111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abb7ee-cdb1-4e29-8da0-90ef0c5df990 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:18.669273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abb7ee-cdb1-4e29-8da0-90ef0c5df990 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:18.669615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82abb7ee-cdb1-4e29-8da0-90ef0c5df990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:18.741650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abb7ee-cdb1-4e29-8da0-90ef0c5df990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:18.743526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82abb7ee-cdb1-4e29-8da0-90ef0c5df990 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:18.760735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 924/1835] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:18.919512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def4875-c16a-4499-9831-3ea74d01543f service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:18.930301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def4875-c16a-4499-9831-3ea74d01543f service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:18.940247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6b6be-3aa7-4f56-80c4-da40a9ab63b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:18.941130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b6be-3aa7-4f56-80c4-da40a9ab63b7 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:18.941606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b6be-3aa7-4f56-80c4-da40a9ab63b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:18.941873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6b6be-3aa7-4f56-80c4-da40a9ab63b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:18.948115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-bbe6b6be-3aa7-4f56-80c4-da40a9ab63b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:19.038166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6b6be-3aa7-4f56-80c4-da40a9ab63b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:19.040108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6b6be-3aa7-4f56-80c4-da40a9ab63b7 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:19.053834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 912/1836] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:19.176491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abb7ee-cdb1-4e29-8da0-90ef0c5df990 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:19.300203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82abb7ee-cdb1-4e29-8da0-90ef0c5df990 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:19.308077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:19.309076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:19.309460 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:19.309837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] PATH_INFO: `/v3/users/b6571839cd1c4fc9873c4bd016208d67` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:19.312492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6571839cd1c4fc9873c4bd016208d67)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:19.313595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:19.409409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6571839cd1c4fc9873c4bd016208d67'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:19.421743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6571839cd1c4fc9873c4bd016208d67'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:19.442770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6571839cd1c4fc9873c4bd016208d67'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:19.481127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6571839cd1c4fc9873c4bd016208d67'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:19.483810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6571839cd1c4fc9873c4bd016208d67'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:19.506500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 925/1837] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:19 2022] DELETE /identity/v3/users/b6571839cd1c4fc9873c4bd016208d67 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:19.511822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc1a94-020c-4d4f-848e-a820c9794b8c None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:19.512652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc1a94-020c-4d4f-848e-a820c9794b8c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:19.513110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc1a94-020c-4d4f-848e-a820c9794b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:19.559933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-8dbc1a94-020c-4d4f-848e-a820c9794b8c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:19.561708 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8dbc1a94-020c-4d4f-848e-a820c9794b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:19.581122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:19.582883 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:19.647539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 913/1838] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:19.709172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fda5e0-4b13-4c81-a87c-5e5d22e8c524 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:19.714198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8df29-1b05-4e75-8142-edb040e6aba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:19.714961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8df29-1b05-4e75-8142-edb040e6aba1 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:19.715319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8df29-1b05-4e75-8142-edb040e6aba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:19.715712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8df29-1b05-4e75-8142-edb040e6aba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:19.717665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-79a8df29-1b05-4e75-8142-edb040e6aba1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:19.772545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc1a94-020c-4d4f-848e-a820c9794b8c None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:19.774250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8dbc1a94-020c-4d4f-848e-a820c9794b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:19.803697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8df29-1b05-4e75-8142-edb040e6aba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:19.805962 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8df29-1b05-4e75-8142-edb040e6aba1 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:19.827593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 926/1839] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:49:19.933307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc1a94-020c-4d4f-848e-a820c9794b8c None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:19.939407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b93a43-0b85-4388-ad4e-7b4c939aa40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:19.940122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93a43-0b85-4388-ad4e-7b4c939aa40f service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:19.940410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93a43-0b85-4388-ad4e-7b4c939aa40f service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:19.940746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b93a43-0b85-4388-ad4e-7b4c939aa40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:19.952786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b93a43-0b85-4388-ad4e-7b4c939aa40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:19.954393 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b93a43-0b85-4388-ad4e-7b4c939aa40f service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:19.976550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 914/1840] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:49:20.253854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16666c-e92c-486d-ab19-e8c893b2c1da None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:20.254352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16666c-e92c-486d-ab19-e8c893b2c1da None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:20.254651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16666c-e92c-486d-ab19-e8c893b2c1da None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:20.257506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 927/1841] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jan 27 16:49:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:49:20.271484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9971ed4-bbe9-4698-91e7-0a72e85ef1ae None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:20.271857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9971ed4-bbe9-4698-91e7-0a72e85ef1ae None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:20.272213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9971ed4-bbe9-4698-91e7-0a72e85ef1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:20.358154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e9971ed4-bbe9-4698-91e7-0a72e85ef1ae None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:20.359659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e9971ed4-bbe9-4698-91e7-0a72e85ef1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:20.499468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 915/1842] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jan 27 16:49:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:20.515742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16666c-e92c-486d-ab19-e8c893b2c1da None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:20.518265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-bf16666c-e92c-486d-ab19-e8c893b2c1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:20.539791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16666c-e92c-486d-ab19-e8c893b2c1da None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:20.550580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f748ef-d8bb-4677-8c4c-99497cf0a674 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:20.551331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f748ef-d8bb-4677-8c4c-99497cf0a674 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:20.551534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f748ef-d8bb-4677-8c4c-99497cf0a674 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:20.551851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f748ef-d8bb-4677-8c4c-99497cf0a674 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:20.566910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f748ef-d8bb-4677-8c4c-99497cf0a674 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:20.568497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f748ef-d8bb-4677-8c4c-99497cf0a674 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:20.581387 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 928/1843] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:20.711318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9971ed4-bbe9-4698-91e7-0a72e85ef1ae None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:20.714410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e9971ed4-bbe9-4698-91e7-0a72e85ef1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:20.735899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9971ed4-bbe9-4698-91e7-0a72e85ef1ae None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:20.746123 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:20.747235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:20.747527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:20.747936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] PATH_INFO: `/v3/projects/6a479cf2c2404472bf23265df57c3a56` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:20.749490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a479cf2c2404472bf23265df57c3a56)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:20.751405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:20.809849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a479cf2c2404472bf23265df57c3a56', 'request_id': 'req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:20.817413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a479cf2c2404472bf23265df57c3a56', 'request_id': 'req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:20.824881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a479cf2c2404472bf23265df57c3a56', 'request_id': 'req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:20.838468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] The token cache is being invalidate because project 6a479cf2c2404472bf23265df57c3a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:20.839082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:20.840128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:20.842152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 916/1844] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:20 2022] DELETE /identity/v3/projects/6a479cf2c2404472bf23265df57c3a56 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:20.845737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f748ef-d8bb-4677-8c4c-99497cf0a674 service nova] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:20.856689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f748ef-d8bb-4677-8c4c-99497cf0a674 service nova] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:20.927812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:20.928759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:20.929129 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:20.929473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] PATH_INFO: `/v3/users/859033bcb8554e8dabafeacb484e9f0b` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:20.933402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=859033bcb8554e8dabafeacb484e9f0b)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:20.936336 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:20.986543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859033bcb8554e8dabafeacb484e9f0b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:20.993524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859033bcb8554e8dabafeacb484e9f0b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:21.005487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859033bcb8554e8dabafeacb484e9f0b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:21.013876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859033bcb8554e8dabafeacb484e9f0b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:21.014550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f81283f2-fe6b-486d-9571-fc3363a88c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859033bcb8554e8dabafeacb484e9f0b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:21.020559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 929/1845] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:20 2022] DELETE /identity/v3/users/859033bcb8554e8dabafeacb484e9f0b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:21.336187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:21.337881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:21.352017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93bf14-090d-47e6-b87f-8a4a87fb5ff3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:21.422517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:21.423393 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.423831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.424115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] PATH_INFO: `/v3/projects/e3b4ade8ab47473c9cf2abaa955c10b6` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:21.425344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b4ade8ab47473c9cf2abaa955c10b6)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:21.427299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:21.475294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b4ade8ab47473c9cf2abaa955c10b6', 'request_id': 'req-d2275169-1332-46fd-8e1a-5e708457e8b5'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:21.483440 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b4ade8ab47473c9cf2abaa955c10b6', 'request_id': 'req-d2275169-1332-46fd-8e1a-5e708457e8b5'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:21.489725 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b4ade8ab47473c9cf2abaa955c10b6', 'request_id': 'req-d2275169-1332-46fd-8e1a-5e708457e8b5'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:21.501385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] The token cache is being invalidate because project e3b4ade8ab47473c9cf2abaa955c10b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:21.501677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:21.502376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2275169-1332-46fd-8e1a-5e708457e8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:21.505076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 917/1846] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:21 2022] DELETE /identity/v3/projects/e3b4ade8ab47473c9cf2abaa955c10b6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:21.511474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074dcf9-9cfe-41ff-a98e-382485b3d8db None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.511964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074dcf9-9cfe-41ff-a98e-382485b3d8db None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.512078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074dcf9-9cfe-41ff-a98e-382485b3d8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:21.531946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-4074dcf9-9cfe-41ff-a98e-382485b3d8db None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:21.533238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4074dcf9-9cfe-41ff-a98e-382485b3d8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:21.599675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 930/1847] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:21.605626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515ef76-4d9b-4baa-8e53-907f947d72fd None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.606105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515ef76-4d9b-4baa-8e53-907f947d72fd None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.606395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a515ef76-4d9b-4baa-8e53-907f947d72fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:21.625236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a515ef76-4d9b-4baa-8e53-907f947d72fd None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:21.626450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a515ef76-4d9b-4baa-8e53-907f947d72fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:21.634500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 918/1848] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:21.638756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074dcf9-9cfe-41ff-a98e-382485b3d8db None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:21.648287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074dcf9-9cfe-41ff-a98e-382485b3d8db None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:21.653430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfee3a-2872-4c2b-b026-691de71bd2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:21.654183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfee3a-2872-4c2b-b026-691de71bd2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.654471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfee3a-2872-4c2b-b026-691de71bd2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.654749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfee3a-2872-4c2b-b026-691de71bd2f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:21.655491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfee3a-2872-4c2b-b026-691de71bd2f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:21.655830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfee3a-2872-4c2b-b026-691de71bd2f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:21.657457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfee3a-2872-4c2b-b026-691de71bd2f1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:21.672973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 931/1849] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:49:21.674043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515ef76-4d9b-4baa-8e53-907f947d72fd None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:21.686282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a515ef76-4d9b-4baa-8e53-907f947d72fd None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:21.691084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561839e8-2cc9-4527-9e9f-fbe1ef6a4432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:21.691781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561839e8-2cc9-4527-9e9f-fbe1ef6a4432 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.692070 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561839e8-2cc9-4527-9e9f-fbe1ef6a4432 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.692351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561839e8-2cc9-4527-9e9f-fbe1ef6a4432 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:21.693100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561839e8-2cc9-4527-9e9f-fbe1ef6a4432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:21.695120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561839e8-2cc9-4527-9e9f-fbe1ef6a4432 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:21.726834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 919/1850] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:21 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:21.729750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfee3a-2872-4c2b-b026-691de71bd2f1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:21.741943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfee3a-2872-4c2b-b026-691de71bd2f1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:21.804619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50498b7-7f34-4b19-8ff9-d9c7407a8508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:21.805290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50498b7-7f34-4b19-8ff9-d9c7407a8508 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.805578 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50498b7-7f34-4b19-8ff9-d9c7407a8508 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.805858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50498b7-7f34-4b19-8ff9-d9c7407a8508 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:21.806574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50498b7-7f34-4b19-8ff9-d9c7407a8508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:21.809538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50498b7-7f34-4b19-8ff9-d9c7407a8508 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:21.831600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 932/1851] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:21 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:21.833752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561839e8-2cc9-4527-9e9f-fbe1ef6a4432 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:21.844726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561839e8-2cc9-4527-9e9f-fbe1ef6a4432 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:21.849322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b11a-d8cd-46cd-b7cf-eadc51dfbc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:21.850053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b11a-d8cd-46cd-b7cf-eadc51dfbc1e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.850287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b11a-d8cd-46cd-b7cf-eadc51dfbc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.850566 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182b11a-d8cd-46cd-b7cf-eadc51dfbc1e admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:21.851292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182b11a-d8cd-46cd-b7cf-eadc51dfbc1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:21.852918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182b11a-d8cd-46cd-b7cf-eadc51dfbc1e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:21.864412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 920/1852] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:21.868544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50498b7-7f34-4b19-8ff9-d9c7407a8508 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:21.879067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50498b7-7f34-4b19-8ff9-d9c7407a8508 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:21.883998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fec1a3-54fe-4eee-9a4a-ada40f434e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:21.884678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fec1a3-54fe-4eee-9a4a-ada40f434e2b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.884987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fec1a3-54fe-4eee-9a4a-ada40f434e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.885300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fec1a3-54fe-4eee-9a4a-ada40f434e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:21.886355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fec1a3-54fe-4eee-9a4a-ada40f434e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:21.888218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fec1a3-54fe-4eee-9a4a-ada40f434e2b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:21.902450 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 933/1853] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:21.903666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b11a-d8cd-46cd-b7cf-eadc51dfbc1e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:21.913717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182b11a-d8cd-46cd-b7cf-eadc51dfbc1e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:21.922138 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10908a28-72e7-4dce-b538-b8dfc1128551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:21.923061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10908a28-72e7-4dce-b538-b8dfc1128551 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.923353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10908a28-72e7-4dce-b538-b8dfc1128551 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.923661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10908a28-72e7-4dce-b538-b8dfc1128551 admin admin] PATH_INFO: `/v3/projects/b58cdd94c83540179522a28faeb0009e/users/aad71a585d05429f8d1c09ad4509813b/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:21.942571 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10908a28-72e7-4dce-b538-b8dfc1128551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58cdd94c83540179522a28faeb0009e, user_id=aad71a585d05429f8d1c09ad4509813b, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:21.945524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10908a28-72e7-4dce-b538-b8dfc1128551 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:21.959988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 921/1854] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:21 2022] PUT /identity/v3/projects/b58cdd94c83540179522a28faeb0009e/users/aad71a585d05429f8d1c09ad4509813b/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:21.971830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01880c-3680-4686-8f78-221c932eb9d7 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:21.972218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01880c-3680-4686-8f78-221c932eb9d7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:21.972647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01880c-3680-4686-8f78-221c932eb9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.009070 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2e01880c-3680-4686-8f78-221c932eb9d7 None None] MFA Rules not processed for user `aad71a585d05429f8d1c09ad4509813b`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:22.010307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2e01880c-3680-4686-8f78-221c932eb9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:22.074993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 934/1855] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:22.079461 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10908a28-72e7-4dce-b538-b8dfc1128551 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.140695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10908a28-72e7-4dce-b538-b8dfc1128551 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.145304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d7c9-f729-49ae-983c-4140acd26f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.145967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d7c9-f729-49ae-983c-4140acd26f21 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.146254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d7c9-f729-49ae-983c-4140acd26f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.146533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d7c9-f729-49ae-983c-4140acd26f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.147258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d7c9-f729-49ae-983c-4140acd26f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.149198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d7c9-f729-49ae-983c-4140acd26f21 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.174697 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 922/1856] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:22 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:22.178786 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01880c-3680-4686-8f78-221c932eb9d7 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.189544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01880c-3680-4686-8f78-221c932eb9d7 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.244315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7b9ed-55d8-4ace-8485-3059d29abb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.246195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7b9ed-55d8-4ace-8485-3059d29abb4a admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.246481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7b9ed-55d8-4ace-8485-3059d29abb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.246758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba7b9ed-55d8-4ace-8485-3059d29abb4a admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.247493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7b9ed-55d8-4ace-8485-3059d29abb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.249425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba7b9ed-55d8-4ace-8485-3059d29abb4a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.270036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 935/1857] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:22 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:22.273637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d7c9-f729-49ae-983c-4140acd26f21 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.284339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d7c9-f729-49ae-983c-4140acd26f21 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.288894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd6701-6efa-4e21-bfb8-bc20756ad450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.289597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd6701-6efa-4e21-bfb8-bc20756ad450 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.289882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd6701-6efa-4e21-bfb8-bc20756ad450 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.290163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd6701-6efa-4e21-bfb8-bc20756ad450 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.290931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd6701-6efa-4e21-bfb8-bc20756ad450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.293065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebd6701-6efa-4e21-bfb8-bc20756ad450 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.303071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 923/1858] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:22.306837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7b9ed-55d8-4ace-8485-3059d29abb4a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.317383 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba7b9ed-55d8-4ace-8485-3059d29abb4a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.321950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6dae0a-4252-4b28-84a5-10ae011597fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.322660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dae0a-4252-4b28-84a5-10ae011597fa admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.323069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dae0a-4252-4b28-84a5-10ae011597fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.323599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6dae0a-4252-4b28-84a5-10ae011597fa admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.324341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dae0a-4252-4b28-84a5-10ae011597fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.325912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6dae0a-4252-4b28-84a5-10ae011597fa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.335311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 936/1859] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:49:22.339384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd6701-6efa-4e21-bfb8-bc20756ad450 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.349246 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd6701-6efa-4e21-bfb8-bc20756ad450 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.353841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea5410-fa3d-467c-b966-9661a1d413f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.355227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea5410-fa3d-467c-b966-9661a1d413f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.355536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea5410-fa3d-467c-b966-9661a1d413f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.355842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea5410-fa3d-467c-b966-9661a1d413f2 admin admin] PATH_INFO: `/v3/projects/ef82dd8fcb494dd2a2f41a084ee7aee6/users/8dd82d3716584708afeec4c3204c5136/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.370517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea5410-fa3d-467c-b966-9661a1d413f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef82dd8fcb494dd2a2f41a084ee7aee6, user_id=8dd82d3716584708afeec4c3204c5136, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.373295 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea5410-fa3d-467c-b966-9661a1d413f2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.387226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 924/1860] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:22 2022] PUT /identity/v3/projects/ef82dd8fcb494dd2a2f41a084ee7aee6/users/8dd82d3716584708afeec4c3204c5136/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:22.399989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761902-af3a-449a-ad8f-9d2b9be59ef6 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.400280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761902-af3a-449a-ad8f-9d2b9be59ef6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.400557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761902-af3a-449a-ad8f-9d2b9be59ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.427096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-50761902-af3a-449a-ad8f-9d2b9be59ef6 None None] MFA Rules not processed for user `8dd82d3716584708afeec4c3204c5136`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:22.428341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-50761902-af3a-449a-ad8f-9d2b9be59ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:22.490854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 937/1861] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:22.495676 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea5410-fa3d-467c-b966-9661a1d413f2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.570457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea5410-fa3d-467c-b966-9661a1d413f2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.576044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d790dc-f868-423d-af94-e8b4c81d9a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.576715 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d790dc-f868-423d-af94-e8b4c81d9a53 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.576997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d790dc-f868-423d-af94-e8b4c81d9a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.577276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d790dc-f868-423d-af94-e8b4c81d9a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.577998 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d790dc-f868-423d-af94-e8b4c81d9a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.581057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d790dc-f868-423d-af94-e8b4c81d9a53 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.619623 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 925/1862] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:22 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:22.622513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761902-af3a-449a-ad8f-9d2b9be59ef6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.633501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761902-af3a-449a-ad8f-9d2b9be59ef6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.692784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705bc50-8d64-4c0e-880c-cba3636022a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.693509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705bc50-8d64-4c0e-880c-cba3636022a6 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.693790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705bc50-8d64-4c0e-880c-cba3636022a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.694063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705bc50-8d64-4c0e-880c-cba3636022a6 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.694775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705bc50-8d64-4c0e-880c-cba3636022a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.696725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705bc50-8d64-4c0e-880c-cba3636022a6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.722601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 938/1863] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:22 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:22.723840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d790dc-f868-423d-af94-e8b4c81d9a53 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.734522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d790dc-f868-423d-af94-e8b4c81d9a53 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.739110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8bcc6-476f-4b29-b471-57cd04a2fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.739811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8bcc6-476f-4b29-b471-57cd04a2fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.740091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8bcc6-476f-4b29-b471-57cd04a2fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.740365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8bcc6-476f-4b29-b471-57cd04a2fa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.741103 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8bcc6-476f-4b29-b471-57cd04a2fa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.742687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8bcc6-476f-4b29-b471-57cd04a2fa78 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.756359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 926/1864] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:49:22.757806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705bc50-8d64-4c0e-880c-cba3636022a6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.767763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705bc50-8d64-4c0e-880c-cba3636022a6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.772537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad86e9d-5dc7-453c-9b17-cf3f195ba3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.773452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad86e9d-5dc7-453c-9b17-cf3f195ba3be admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.773736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad86e9d-5dc7-453c-9b17-cf3f195ba3be admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.774014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad86e9d-5dc7-453c-9b17-cf3f195ba3be admin admin] PATH_INFO: `/v3/projects/6a6c9ce81c81431ea7a1b2a37f1d2e4e/users/a53ad48007884cd89726bc06260ad112/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.789271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad86e9d-5dc7-453c-9b17-cf3f195ba3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6c9ce81c81431ea7a1b2a37f1d2e4e, user_id=a53ad48007884cd89726bc06260ad112, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.792711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad86e9d-5dc7-453c-9b17-cf3f195ba3be admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.804737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 939/1865] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:22 2022] PUT /identity/v3/projects/6a6c9ce81c81431ea7a1b2a37f1d2e4e/users/a53ad48007884cd89726bc06260ad112/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:22.808612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8bcc6-476f-4b29-b471-57cd04a2fa78 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.818265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8bcc6-476f-4b29-b471-57cd04a2fa78 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.872817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e3175-cafa-4302-99cc-4e2cc9acb590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.873402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e3175-cafa-4302-99cc-4e2cc9acb590 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.873690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e3175-cafa-4302-99cc-4e2cc9acb590 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.873967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e3175-cafa-4302-99cc-4e2cc9acb590 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.874825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e3175-cafa-4302-99cc-4e2cc9acb590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.876427 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e3175-cafa-4302-99cc-4e2cc9acb590 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.886487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 927/1866] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:49:22.890644 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad86e9d-5dc7-453c-9b17-cf3f195ba3be admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:22.902276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad86e9d-5dc7-453c-9b17-cf3f195ba3be admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:22.907442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3f531-d6df-4dc3-afc5-65563ef6b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:22.908384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f531-d6df-4dc3-afc5-65563ef6b73c admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.908667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f531-d6df-4dc3-afc5-65563ef6b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.908944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3f531-d6df-4dc3-afc5-65563ef6b73c admin admin] PATH_INFO: `/v3/projects/6a6c9ce81c81431ea7a1b2a37f1d2e4e/users/a53ad48007884cd89726bc06260ad112/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.910890 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3f531-d6df-4dc3-afc5-65563ef6b73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6c9ce81c81431ea7a1b2a37f1d2e4e, user_id=a53ad48007884cd89726bc06260ad112, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:22.913547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3f531-d6df-4dc3-afc5-65563ef6b73c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:22.924093 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 940/1867] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:22 2022] PUT /identity/v3/projects/6a6c9ce81c81431ea7a1b2a37f1d2e4e/users/a53ad48007884cd89726bc06260ad112/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:22.935734 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cd5bc-042d-4888-8b23-9902f8bbe0c5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:22.936031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cd5bc-042d-4888-8b23-9902f8bbe0c5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:22.936318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cd5bc-042d-4888-8b23-9902f8bbe0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:22.961745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-0a0cd5bc-042d-4888-8b23-9902f8bbe0c5 None None] MFA Rules not processed for user `a53ad48007884cd89726bc06260ad112`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:22.962964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0a0cd5bc-042d-4888-8b23-9902f8bbe0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:23.035450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 928/1868] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:23.042009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3f531-d6df-4dc3-afc5-65563ef6b73c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:23.043851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-12d3f531-d6df-4dc3-afc5-65563ef6b73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:23.099191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3f531-d6df-4dc3-afc5-65563ef6b73c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:23.102826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac2eb9-9937-4c74-8e2f-04387a126a3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:23.103471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac2eb9-9937-4c74-8e2f-04387a126a3d service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:23.103785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac2eb9-9937-4c74-8e2f-04387a126a3d service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:23.104561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac2eb9-9937-4c74-8e2f-04387a126a3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:23.159855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac2eb9-9937-4c74-8e2f-04387a126a3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:23.161296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac2eb9-9937-4c74-8e2f-04387a126a3d service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:23.170596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 941/1869] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:24.922384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cd5bc-042d-4888-8b23-9902f8bbe0c5 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:24.924017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0a0cd5bc-042d-4888-8b23-9902f8bbe0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:24.936740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cd5bc-042d-4888-8b23-9902f8bbe0c5 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:24.941720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d299f-c8cb-4c74-8b64-7c8b92ad9e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:24.942691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d299f-c8cb-4c74-8b64-7c8b92ad9e6a service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:24.943096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d299f-c8cb-4c74-8b64-7c8b92ad9e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:24.943442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d299f-c8cb-4c74-8b64-7c8b92ad9e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:25.001719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d299f-c8cb-4c74-8b64-7c8b92ad9e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:25.003365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d299f-c8cb-4c74-8b64-7c8b92ad9e6a service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:25.015380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 929/1870] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:25.655060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac2eb9-9937-4c74-8e2f-04387a126a3d service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:25.663643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac2eb9-9937-4c74-8e2f-04387a126a3d service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:25.668101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc49794-a5f8-4bef-a9e3-9491b75a6322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:25.668741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49794-a5f8-4bef-a9e3-9491b75a6322 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:25.669026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49794-a5f8-4bef-a9e3-9491b75a6322 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:25.669308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc49794-a5f8-4bef-a9e3-9491b75a6322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:25.679526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc49794-a5f8-4bef-a9e3-9491b75a6322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:25.680995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc49794-a5f8-4bef-a9e3-9491b75a6322 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:25.700372 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 942/1871] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:26.335162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d299f-c8cb-4c74-8b64-7c8b92ad9e6a service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:26.336907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3f2d299f-c8cb-4c74-8b64-7c8b92ad9e6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:26.405194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d299f-c8cb-4c74-8b64-7c8b92ad9e6a service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:26.409680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:26.410559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:26.410840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:26.411116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] PATH_INFO: `/v3/users/36948615912442df88e3f4bf397050da` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:26.412313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36948615912442df88e3f4bf397050da)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:26.414212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:26.458312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36948615912442df88e3f4bf397050da'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:26.465068 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36948615912442df88e3f4bf397050da'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:26.465731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36948615912442df88e3f4bf397050da'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:26.476775 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36948615912442df88e3f4bf397050da'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:26.483185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36948615912442df88e3f4bf397050da'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:26.489180 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 930/1872] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:26 2022] DELETE /identity/v3/users/36948615912442df88e3f4bf397050da => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:26.493855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816133bd-82f6-46aa-8846-f5688dc4f8da None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:26.494148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816133bd-82f6-46aa-8846-f5688dc4f8da None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:26.495002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816133bd-82f6-46aa-8846-f5688dc4f8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:26.514853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-816133bd-82f6-46aa-8846-f5688dc4f8da None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:26.516137 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-816133bd-82f6-46aa-8846-f5688dc4f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:26.573660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 943/1873] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:26.584634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:26.586009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:26.641108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412197b-04a4-4193-8a56-4cef5c8821a1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:26.644730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd8ca-62bb-418c-b229-799b03b286b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:26.645374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd8ca-62bb-418c-b229-799b03b286b6 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:26.645655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd8ca-62bb-418c-b229-799b03b286b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:26.645932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd8ca-62bb-418c-b229-799b03b286b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:26.655476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bd8ca-62bb-418c-b229-799b03b286b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:26.656923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bd8ca-62bb-418c-b229-799b03b286b6 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:26.667128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 931/1874] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:49:26.944807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816133bd-82f6-46aa-8846-f5688dc4f8da None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:26.946433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-816133bd-82f6-46aa-8846-f5688dc4f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:26.961633 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816133bd-82f6-46aa-8846-f5688dc4f8da None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:26.968981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:26.970157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:26.970635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:26.970904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] PATH_INFO: `/v3/projects/6584646e674b4971a46b22c596810796` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:26.972392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6584646e674b4971a46b22c596810796)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:26.974668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:27.023208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6584646e674b4971a46b22c596810796', 'request_id': 'req-50ad6040-82d8-4f64-9630-e3c328375cd4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.030235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6584646e674b4971a46b22c596810796', 'request_id': 'req-50ad6040-82d8-4f64-9630-e3c328375cd4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.035906 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6584646e674b4971a46b22c596810796', 'request_id': 'req-50ad6040-82d8-4f64-9630-e3c328375cd4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.050776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] The token cache is being invalidate because project 6584646e674b4971a46b22c596810796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:27.051039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.061185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.061185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 944/1875] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:26 2022] DELETE /identity/v3/projects/6584646e674b4971a46b22c596810796 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:27.062060 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd8ca-62bb-418c-b229-799b03b286b6 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:27.072697 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd8ca-62bb-418c-b229-799b03b286b6 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:27.136926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:27.138172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:27.138630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:27.139001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] PATH_INFO: `/v3/users/795987fd10f34d9483c78fee3b595961` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:27.140641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=795987fd10f34d9483c78fee3b595961)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:27.142657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:27.192857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795987fd10f34d9483c78fee3b595961'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.199918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795987fd10f34d9483c78fee3b595961'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.200607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795987fd10f34d9483c78fee3b595961'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.212470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795987fd10f34d9483c78fee3b595961'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.221927 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-65fff5c3-44a0-4a13-9347-e33fdb0b6fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795987fd10f34d9483c78fee3b595961'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.228478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 932/1876] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:27 2022] DELETE /identity/v3/users/795987fd10f34d9483c78fee3b595961 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:27.549502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:27.551060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:27.564482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad6040-82d8-4f64-9630-e3c328375cd4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:27.627417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:27.628313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:27.628599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:27.628874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] PATH_INFO: `/v3/projects/fff86ba087154ef8835cd1d0943e979a` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:27.630083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff86ba087154ef8835cd1d0943e979a)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:27.632055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:27.677896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff86ba087154ef8835cd1d0943e979a', 'request_id': 'req-f82ae80f-d65d-448c-b303-2a235dd3a6d2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.684933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff86ba087154ef8835cd1d0943e979a', 'request_id': 'req-f82ae80f-d65d-448c-b303-2a235dd3a6d2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.690497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff86ba087154ef8835cd1d0943e979a', 'request_id': 'req-f82ae80f-d65d-448c-b303-2a235dd3a6d2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.703586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] The token cache is being invalidate because project fff86ba087154ef8835cd1d0943e979a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:27.703888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.704530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f82ae80f-d65d-448c-b303-2a235dd3a6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:27.706089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 945/1877] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:27 2022] DELETE /identity/v3/projects/fff86ba087154ef8835cd1d0943e979a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:27.712813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7b54f-3854-49f8-91bb-46dccb553bc3 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:27.713981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7b54f-3854-49f8-91bb-46dccb553bc3 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:27.713981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7b54f-3854-49f8-91bb-46dccb553bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:27.732514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1aa7b54f-3854-49f8-91bb-46dccb553bc3 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:27.733725 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1aa7b54f-3854-49f8-91bb-46dccb553bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:27.798581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 933/1878] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:27.807925 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a8833-e6ad-45c8-b270-5ca8ebdac6ba None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:27.808221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a8833-e6ad-45c8-b270-5ca8ebdac6ba None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:27.808504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a8833-e6ad-45c8-b270-5ca8ebdac6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:27.827379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-214a8833-e6ad-45c8-b270-5ca8ebdac6ba None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:27.828624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-214a8833-e6ad-45c8-b270-5ca8ebdac6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:27.838503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 946/1879] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:27.843105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7b54f-3854-49f8-91bb-46dccb553bc3 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:27.854535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7b54f-3854-49f8-91bb-46dccb553bc3 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:27.859607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac473a-3f4e-40b3-915b-00fa75fb90bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:27.860415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac473a-3f4e-40b3-915b-00fa75fb90bd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:27.860804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac473a-3f4e-40b3-915b-00fa75fb90bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:27.861188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac473a-3f4e-40b3-915b-00fa75fb90bd admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:27.862043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac473a-3f4e-40b3-915b-00fa75fb90bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:27.862465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac473a-3f4e-40b3-915b-00fa75fb90bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:27.864484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac473a-3f4e-40b3-915b-00fa75fb90bd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:27.879612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 934/1880] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:49:27.883677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a8833-e6ad-45c8-b270-5ca8ebdac6ba None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:27.897513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a8833-e6ad-45c8-b270-5ca8ebdac6ba None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:27.904961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee3cab-803a-4eba-aee3-e6c8d8a71948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:27.905945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee3cab-803a-4eba-aee3-e6c8d8a71948 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:27.906229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee3cab-803a-4eba-aee3-e6c8d8a71948 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:27.906504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee3cab-803a-4eba-aee3-e6c8d8a71948 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:27.907221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee3cab-803a-4eba-aee3-e6c8d8a71948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:27.909230 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee3cab-803a-4eba-aee3-e6c8d8a71948 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:27.935481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 947/1881] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:27 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:27.939690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac473a-3f4e-40b3-915b-00fa75fb90bd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:27.950113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac473a-3f4e-40b3-915b-00fa75fb90bd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:28.005580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfada91d-8223-4694-a761-4ebdb4f4c32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:28.006261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfada91d-8223-4694-a761-4ebdb4f4c32e admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:28.006551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfada91d-8223-4694-a761-4ebdb4f4c32e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:28.006838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfada91d-8223-4694-a761-4ebdb4f4c32e admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:28.007555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfada91d-8223-4694-a761-4ebdb4f4c32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:28.009521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfada91d-8223-4694-a761-4ebdb4f4c32e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:28.033216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 935/1882] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:27 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:28.034381 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee3cab-803a-4eba-aee3-e6c8d8a71948 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:28.044881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee3cab-803a-4eba-aee3-e6c8d8a71948 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:28.049526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f06b3-39cf-4178-a4a5-606548da6255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:28.050198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f06b3-39cf-4178-a4a5-606548da6255 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:28.050487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f06b3-39cf-4178-a4a5-606548da6255 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:28.050768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f06b3-39cf-4178-a4a5-606548da6255 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:28.051545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f06b3-39cf-4178-a4a5-606548da6255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:28.053176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f06b3-39cf-4178-a4a5-606548da6255 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:28.064314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 948/1883] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:49:28.068283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfada91d-8223-4694-a761-4ebdb4f4c32e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:28.078931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfada91d-8223-4694-a761-4ebdb4f4c32e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:28.083740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7fd93-7705-4b29-b595-ec613aee3ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:28.084414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7fd93-7705-4b29-b595-ec613aee3ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:28.084695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7fd93-7705-4b29-b595-ec613aee3ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:28.084985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7fd93-7705-4b29-b595-ec613aee3ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:28.085744 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7fd93-7705-4b29-b595-ec613aee3ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:28.087318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7fd93-7705-4b29-b595-ec613aee3ef1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:28.101460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 936/1884] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:28.102636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f06b3-39cf-4178-a4a5-606548da6255 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:28.114371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f06b3-39cf-4178-a4a5-606548da6255 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:28.119281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32b1f4-9d9d-4751-955d-2f27632bcf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:28.120880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32b1f4-9d9d-4751-955d-2f27632bcf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:28.121209 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32b1f4-9d9d-4751-955d-2f27632bcf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:28.121564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32b1f4-9d9d-4751-955d-2f27632bcf07 admin admin] PATH_INFO: `/v3/projects/e3cd8210efbb4cfa91846d35817f67f4/users/d759fe3e4b7745318fce75e2e746ab4b/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:28.138416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32b1f4-9d9d-4751-955d-2f27632bcf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cd8210efbb4cfa91846d35817f67f4, user_id=d759fe3e4b7745318fce75e2e746ab4b, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:28.141581 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32b1f4-9d9d-4751-955d-2f27632bcf07 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:28.167918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 949/1885] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:28 2022] PUT /identity/v3/projects/e3cd8210efbb4cfa91846d35817f67f4/users/d759fe3e4b7745318fce75e2e746ab4b/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:28.179875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02798-2836-45a4-99f5-af4e54d58584 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:28.180225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02798-2836-45a4-99f5-af4e54d58584 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:28.180443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc02798-2836-45a4-99f5-af4e54d58584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:28.208223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9fc02798-2836-45a4-99f5-af4e54d58584 None None] MFA Rules not processed for user `d759fe3e4b7745318fce75e2e746ab4b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:28.209439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9fc02798-2836-45a4-99f5-af4e54d58584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:28.281241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 937/1886] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:28.292337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32b1f4-9d9d-4751-955d-2f27632bcf07 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:28.294037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4f32b1f4-9d9d-4751-955d-2f27632bcf07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:28.355756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32b1f4-9d9d-4751-955d-2f27632bcf07 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:28.359537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109f5db-c987-4267-b290-5cb1de4471a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:28.360362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109f5db-c987-4267-b290-5cb1de4471a7 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:28.360724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109f5db-c987-4267-b290-5cb1de4471a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:28.361084 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109f5db-c987-4267-b290-5cb1de4471a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:28.370726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109f5db-c987-4267-b290-5cb1de4471a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:28.372306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109f5db-c987-4267-b290-5cb1de4471a7 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:28.383007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 950/1887] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:37.981721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc02798-2836-45a4-99f5-af4e54d58584 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:37.983223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9fc02798-2836-45a4-99f5-af4e54d58584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:38.058284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc02798-2836-45a4-99f5-af4e54d58584 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:38.062749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:38.063655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:38.063941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:38.064221 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] PATH_INFO: `/v3/users/aad71a585d05429f8d1c09ad4509813b` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:38.065420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad71a585d05429f8d1c09ad4509813b)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:38.067360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:38.121157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad71a585d05429f8d1c09ad4509813b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.128281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad71a585d05429f8d1c09ad4509813b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.129116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad71a585d05429f8d1c09ad4509813b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.141303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad71a585d05429f8d1c09ad4509813b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.148460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad71a585d05429f8d1c09ad4509813b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.155220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 938/1888] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:37 2022] DELETE /identity/v3/users/aad71a585d05429f8d1c09ad4509813b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:38.159723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ffe72-b80b-4c2e-9ba1-32baec812ef3 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:38.160197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ffe72-b80b-4c2e-9ba1-32baec812ef3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:38.160361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770ffe72-b80b-4c2e-9ba1-32baec812ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:38.178260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-770ffe72-b80b-4c2e-9ba1-32baec812ef3 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:38.179601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-770ffe72-b80b-4c2e-9ba1-32baec812ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:38.240432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 951/1889] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:38.262322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:38.263758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:38.319840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec79ee-2a2f-46a3-b08f-acc13471e82a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:38.323520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500a33-9720-4a9d-ae84-fc6c8d8c0efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:38.324203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500a33-9720-4a9d-ae84-fc6c8d8c0efa service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:38.324488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500a33-9720-4a9d-ae84-fc6c8d8c0efa service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:38.324769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500a33-9720-4a9d-ae84-fc6c8d8c0efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:38.333796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95500a33-9720-4a9d-ae84-fc6c8d8c0efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:38.335222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95500a33-9720-4a9d-ae84-fc6c8d8c0efa service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:38.345464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 939/1890] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:38.604653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ffe72-b80b-4c2e-9ba1-32baec812ef3 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:38.606249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-770ffe72-b80b-4c2e-9ba1-32baec812ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:38.619542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770ffe72-b80b-4c2e-9ba1-32baec812ef3 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:38.634519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:38.635724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:38.635989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:38.636301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] PATH_INFO: `/v3/projects/b58cdd94c83540179522a28faeb0009e` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:38.637545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58cdd94c83540179522a28faeb0009e)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:38.639463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:38.704804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58cdd94c83540179522a28faeb0009e', 'request_id': 'req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.711090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58cdd94c83540179522a28faeb0009e', 'request_id': 'req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.716670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58cdd94c83540179522a28faeb0009e', 'request_id': 'req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.731278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] The token cache is being invalidate because project b58cdd94c83540179522a28faeb0009e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:38.731583 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.732213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.734352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 952/1891] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:38 2022] DELETE /identity/v3/projects/b58cdd94c83540179522a28faeb0009e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:38.738465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500a33-9720-4a9d-ae84-fc6c8d8c0efa service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:38.749864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500a33-9720-4a9d-ae84-fc6c8d8c0efa service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:38.817941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:38.819324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:38.819881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:38.820436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] PATH_INFO: `/v3/users/8dd82d3716584708afeec4c3204c5136` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:38.822128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd82d3716584708afeec4c3204c5136)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:38.824789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:38.909814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd82d3716584708afeec4c3204c5136'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.919280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd82d3716584708afeec4c3204c5136'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.920077 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd82d3716584708afeec4c3204c5136'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.936683 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd82d3716584708afeec4c3204c5136'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.945516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd82d3716584708afeec4c3204c5136'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:38.954344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 940/1892] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:38 2022] DELETE /identity/v3/users/8dd82d3716584708afeec4c3204c5136 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:39.504652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:39.506292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:39.521044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83eafa6-60a1-4947-a3fd-c34f5a932b3e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:39.604540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:39.605466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:39.605750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:39.610300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] PATH_INFO: `/v3/projects/ef82dd8fcb494dd2a2f41a084ee7aee6` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:39.611879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef82dd8fcb494dd2a2f41a084ee7aee6)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:39.613875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:39.664760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef82dd8fcb494dd2a2f41a084ee7aee6', 'request_id': 'req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.672538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef82dd8fcb494dd2a2f41a084ee7aee6', 'request_id': 'req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.678300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef82dd8fcb494dd2a2f41a084ee7aee6', 'request_id': 'req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.690445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] The token cache is being invalidate because project ef82dd8fcb494dd2a2f41a084ee7aee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:39.690664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.691427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90a8860a-8d4e-4a86-af82-8702cb4f4a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.693891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 953/1893] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:39 2022] DELETE /identity/v3/projects/ef82dd8fcb494dd2a2f41a084ee7aee6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:39.697909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:39.699225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:39.713410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04471a-0b4f-4dc4-97a8-0346393addaa admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:39.771013 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:39.771930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:39.772243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:39.772529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] PATH_INFO: `/v3/users/a53ad48007884cd89726bc06260ad112` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:39.773762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53ad48007884cd89726bc06260ad112)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:39.776524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:39.804398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d4159-0fe8-4d68-8bc4-b48d365a658c None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:39.804770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d4159-0fe8-4d68-8bc4-b48d365a658c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:39.805120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d4159-0fe8-4d68-8bc4-b48d365a658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:39.827021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-795d4159-0fe8-4d68-8bc4-b48d365a658c None None] MFA Rules not processed for user `3cfe4a71879849b581eb8b48b24107fd`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:39.828504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-795d4159-0fe8-4d68-8bc4-b48d365a658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:39.831524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53ad48007884cd89726bc06260ad112'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.839776 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53ad48007884cd89726bc06260ad112'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.840566 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53ad48007884cd89726bc06260ad112'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.852330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53ad48007884cd89726bc06260ad112'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.860345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53ad48007884cd89726bc06260ad112'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:39.867499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 941/1894] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:39 2022] DELETE /identity/v3/users/a53ad48007884cd89726bc06260ad112 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:39.895335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 954/1895] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:39.935795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:39.938064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:40.025140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c502b59-a300-40c2-b403-9a7ffa3c5c68 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:40.030554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:40.031658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:40.032093 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:40.032520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] PATH_INFO: `/v3/users/d759fe3e4b7745318fce75e2e746ab4b` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:40.033894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d759fe3e4b7745318fce75e2e746ab4b)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:40.036189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:40.102001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd759fe3e4b7745318fce75e2e746ab4b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.111497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd759fe3e4b7745318fce75e2e746ab4b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.112490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd759fe3e4b7745318fce75e2e746ab4b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.127008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd759fe3e4b7745318fce75e2e746ab4b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.135834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd759fe3e4b7745318fce75e2e746ab4b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.142480 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 942/1896] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:39 2022] DELETE /identity/v3/users/d759fe3e4b7745318fce75e2e746ab4b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:40.147488 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a19b-81f5-42cd-80ed-e2163ae70f2a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:40.147927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a19b-81f5-42cd-80ed-e2163ae70f2a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:40.148923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da02a19b-81f5-42cd-80ed-e2163ae70f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:40.174308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-da02a19b-81f5-42cd-80ed-e2163ae70f2a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:40.175653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-da02a19b-81f5-42cd-80ed-e2163ae70f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:40.248520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 955/1897] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:40.279835 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:40.281764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:40.346847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d515e306-31fa-476e-ad4c-a490a6676074 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:40.351353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad6883c-78d0-4dbc-8dd6-fd296d99414b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:40.352075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6883c-78d0-4dbc-8dd6-fd296d99414b service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:40.353511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6883c-78d0-4dbc-8dd6-fd296d99414b service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:40.353823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad6883c-78d0-4dbc-8dd6-fd296d99414b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:40.372291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6883c-78d0-4dbc-8dd6-fd296d99414b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:40.380301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad6883c-78d0-4dbc-8dd6-fd296d99414b service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:40.388961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 943/1898] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:40.453535 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02a19b-81f5-42cd-80ed-e2163ae70f2a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:40.455096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-da02a19b-81f5-42cd-80ed-e2163ae70f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:40.477326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da02a19b-81f5-42cd-80ed-e2163ae70f2a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:40.486181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:40.487407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:40.487740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:40.488690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] PATH_INFO: `/v3/projects/6a6c9ce81c81431ea7a1b2a37f1d2e4e` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:40.492081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6c9ce81c81431ea7a1b2a37f1d2e4e)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:40.497119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:40.550376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6c9ce81c81431ea7a1b2a37f1d2e4e', 'request_id': 'req-4484e585-18a0-4055-b188-23d4f873b461'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.557720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6c9ce81c81431ea7a1b2a37f1d2e4e', 'request_id': 'req-4484e585-18a0-4055-b188-23d4f873b461'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.566218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6c9ce81c81431ea7a1b2a37f1d2e4e', 'request_id': 'req-4484e585-18a0-4055-b188-23d4f873b461'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.581602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] The token cache is being invalidate because project 6a6c9ce81c81431ea7a1b2a37f1d2e4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:40.582174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.583278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4484e585-18a0-4055-b188-23d4f873b461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:40.584756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 956/1899] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:40 2022] DELETE /identity/v3/projects/6a6c9ce81c81431ea7a1b2a37f1d2e4e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:40.591225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bc346-327c-4b7a-8b88-2a879cbb7fa6 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:40.591650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bc346-327c-4b7a-8b88-2a879cbb7fa6 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:40.591960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155bc346-327c-4b7a-8b88-2a879cbb7fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:40.613969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-155bc346-327c-4b7a-8b88-2a879cbb7fa6 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:40.615860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-155bc346-327c-4b7a-8b88-2a879cbb7fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:40.699774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 944/1900] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:40.701589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4c95b-243a-4c22-83cf-bc9b0fe93e2d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:40.701882 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4c95b-243a-4c22-83cf-bc9b0fe93e2d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:40.702163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea4c95b-243a-4c22-83cf-bc9b0fe93e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:40.728861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2ea4c95b-243a-4c22-83cf-bc9b0fe93e2d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:40.729989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2ea4c95b-243a-4c22-83cf-bc9b0fe93e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:40.742950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 957/1901] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:40.744806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bc346-327c-4b7a-8b88-2a879cbb7fa6 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:40.757729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155bc346-327c-4b7a-8b88-2a879cbb7fa6 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:40.779898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab025b9-607d-48d8-81eb-82124d189daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:40.780642 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab025b9-607d-48d8-81eb-82124d189daa admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:40.780854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab025b9-607d-48d8-81eb-82124d189daa admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:40.781215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab025b9-607d-48d8-81eb-82124d189daa admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:40.786901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab025b9-607d-48d8-81eb-82124d189daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:40.787475 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab025b9-607d-48d8-81eb-82124d189daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:40.794625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab025b9-607d-48d8-81eb-82124d189daa admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:40.827959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4c95b-243a-4c22-83cf-bc9b0fe93e2d None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:40.829184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 945/1902] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:49:40.838458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea4c95b-243a-4c22-83cf-bc9b0fe93e2d None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:40.843492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f933c-f0e6-4581-a469-290f6cdfd2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:40.844651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f933c-f0e6-4581-a469-290f6cdfd2ed admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:40.845148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f933c-f0e6-4581-a469-290f6cdfd2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:40.845625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f933c-f0e6-4581-a469-290f6cdfd2ed admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:40.846540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f933c-f0e6-4581-a469-290f6cdfd2ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:40.848833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f933c-f0e6-4581-a469-290f6cdfd2ed admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:40.893060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 958/1903] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:40 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:40.897640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab025b9-607d-48d8-81eb-82124d189daa admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:40.909906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab025b9-607d-48d8-81eb-82124d189daa admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:40.974354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc8a2d-00c5-45e3-8660-719e9afa9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:40.975028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc8a2d-00c5-45e3-8660-719e9afa9a92 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:40.975314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc8a2d-00c5-45e3-8660-719e9afa9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:40.975999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc8a2d-00c5-45e3-8660-719e9afa9a92 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:40.977422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc8a2d-00c5-45e3-8660-719e9afa9a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:40.979648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc8a2d-00c5-45e3-8660-719e9afa9a92 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.003732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 946/1904] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:40 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:41.006479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f933c-f0e6-4581-a469-290f6cdfd2ed admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.018811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f933c-f0e6-4581-a469-290f6cdfd2ed admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.024458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d5e99-f78b-44dd-86ca-0ad1405be6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.025541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d5e99-f78b-44dd-86ca-0ad1405be6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.026007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d5e99-f78b-44dd-86ca-0ad1405be6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.026334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d5e99-f78b-44dd-86ca-0ad1405be6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.027588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d5e99-f78b-44dd-86ca-0ad1405be6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.029340 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740d5e99-f78b-44dd-86ca-0ad1405be6e1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.042730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 959/1905] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:49:41.050980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc8a2d-00c5-45e3-8660-719e9afa9a92 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.070145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc8a2d-00c5-45e3-8660-719e9afa9a92 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.081399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e691fbd-6d16-4c1c-9b6e-2e48394d4fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.082390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691fbd-6d16-4c1c-9b6e-2e48394d4fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.082925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691fbd-6d16-4c1c-9b6e-2e48394d4fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.083431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e691fbd-6d16-4c1c-9b6e-2e48394d4fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.084453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e691fbd-6d16-4c1c-9b6e-2e48394d4fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.086923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e691fbd-6d16-4c1c-9b6e-2e48394d4fd0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.107471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 947/1906] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:41.108976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d5e99-f78b-44dd-86ca-0ad1405be6e1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.120684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740d5e99-f78b-44dd-86ca-0ad1405be6e1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.127747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97c5e3-40f3-459a-aea7-56a3f8b845ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.129358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97c5e3-40f3-459a-aea7-56a3f8b845ff admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.129828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97c5e3-40f3-459a-aea7-56a3f8b845ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.130853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97c5e3-40f3-459a-aea7-56a3f8b845ff admin admin] PATH_INFO: `/v3/projects/9bc4dafc57324684be2e14db0fb58823/users/f845b289b498448da4cbc106a26fd29a/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.151713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97c5e3-40f3-459a-aea7-56a3f8b845ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc4dafc57324684be2e14db0fb58823, user_id=f845b289b498448da4cbc106a26fd29a, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.155194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97c5e3-40f3-459a-aea7-56a3f8b845ff admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.170619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 960/1907] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:41 2022] PUT /identity/v3/projects/9bc4dafc57324684be2e14db0fb58823/users/f845b289b498448da4cbc106a26fd29a/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:41.182203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a45434-2fd8-4c81-92e8-d6a46d6aeba1 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.182450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a45434-2fd8-4c81-92e8-d6a46d6aeba1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.182753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a45434-2fd8-4c81-92e8-d6a46d6aeba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.213841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-34a45434-2fd8-4c81-92e8-d6a46d6aeba1 None None] MFA Rules not processed for user `f845b289b498448da4cbc106a26fd29a`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:41.215071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-34a45434-2fd8-4c81-92e8-d6a46d6aeba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:41.220153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97c5e3-40f3-459a-aea7-56a3f8b845ff admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.222806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4f97c5e3-40f3-459a-aea7-56a3f8b845ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:41.295491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 948/1908] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:41.307827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a45434-2fd8-4c81-92e8-d6a46d6aeba1 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.309431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-34a45434-2fd8-4c81-92e8-d6a46d6aeba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:41.315084 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97c5e3-40f3-459a-aea7-56a3f8b845ff admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.321475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.323515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.324164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.325191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] PATH_INFO: `/v3/projects/e3cd8210efbb4cfa91846d35817f67f4` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.326708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3cd8210efbb4cfa91846d35817f67f4)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.329519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.393690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3cd8210efbb4cfa91846d35817f67f4', 'request_id': 'req-b69bf97f-40a2-4d11-9f55-d1036fa2414f'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:41.408482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3cd8210efbb4cfa91846d35817f67f4', 'request_id': 'req-b69bf97f-40a2-4d11-9f55-d1036fa2414f'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:41.411424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a45434-2fd8-4c81-92e8-d6a46d6aeba1 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.414467 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3cd8210efbb4cfa91846d35817f67f4', 'request_id': 'req-b69bf97f-40a2-4d11-9f55-d1036fa2414f'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:41.439749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] The token cache is being invalidate because project e3cd8210efbb4cfa91846d35817f67f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:41.440140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:41.441023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b69bf97f-40a2-4d11-9f55-d1036fa2414f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:41.447311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 961/1909] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:41 2022] DELETE /identity/v3/projects/e3cd8210efbb4cfa91846d35817f67f4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:41.452635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d50b7-6526-421c-825c-9eddc39ef58b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.453004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d50b7-6526-421c-825c-9eddc39ef58b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.453362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d50b7-6526-421c-825c-9eddc39ef58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.473020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b96d50b7-6526-421c-825c-9eddc39ef58b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:41.474508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b96d50b7-6526-421c-825c-9eddc39ef58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:41.479097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f1793-9d57-4f4e-bab9-d02f41871cdb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '295fe8f61f87423bb49471e2f0085690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.480067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f1793-9d57-4f4e-bab9-d02f41871cdb service glance] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.480618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f1793-9d57-4f4e-bab9-d02f41871cdb service glance] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.481299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f1793-9d57-4f4e-bab9-d02f41871cdb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.483742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-113f1793-9d57-4f4e-bab9-d02f41871cdb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:41.562638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 962/1910] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:41.570056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3b09-6d6f-419a-86b6-4216f3c7ae81 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.570346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3b09-6d6f-419a-86b6-4216f3c7ae81 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.570628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f3b09-6d6f-419a-86b6-4216f3c7ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.574592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f1793-9d57-4f4e-bab9-d02f41871cdb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.576394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f1793-9d57-4f4e-bab9-d02f41871cdb service glance] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.586527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 949/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:41.590841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-097f3b09-6d6f-419a-86b6-4216f3c7ae81 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:41.592167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-097f3b09-6d6f-419a-86b6-4216f3c7ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:41.605213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 963/1912] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:41.606045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f1793-9d57-4f4e-bab9-d02f41871cdb service glance] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.617638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f1793-9d57-4f4e-bab9-d02f41871cdb service glance] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.623762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36cb69-7002-421a-82be-27cd5a3aaa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.624551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36cb69-7002-421a-82be-27cd5a3aaa0f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.624838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36cb69-7002-421a-82be-27cd5a3aaa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.625117 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36cb69-7002-421a-82be-27cd5a3aaa0f admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.625954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36cb69-7002-421a-82be-27cd5a3aaa0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:41.626247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36cb69-7002-421a-82be-27cd5a3aaa0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.629132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36cb69-7002-421a-82be-27cd5a3aaa0f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.644523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 950/1913] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:49:41.648504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3b09-6d6f-419a-86b6-4216f3c7ae81 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.658928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f3b09-6d6f-419a-86b6-4216f3c7ae81 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.669304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5ed83-fc50-46c9-8c83-0e76f479c8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.670221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5ed83-fc50-46c9-8c83-0e76f479c8ed admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.670543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5ed83-fc50-46c9-8c83-0e76f479c8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.670887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5ed83-fc50-46c9-8c83-0e76f479c8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.671812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5ed83-fc50-46c9-8c83-0e76f479c8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.679018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5ed83-fc50-46c9-8c83-0e76f479c8ed admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.708584 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 964/1914] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:41 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:41.712693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36cb69-7002-421a-82be-27cd5a3aaa0f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.727010 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36cb69-7002-421a-82be-27cd5a3aaa0f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.794793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a2c28-8b77-431c-a9f6-e2278d875d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.795937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a2c28-8b77-431c-a9f6-e2278d875d96 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.796233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a2c28-8b77-431c-a9f6-e2278d875d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.796516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a2c28-8b77-431c-a9f6-e2278d875d96 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.797256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a2c28-8b77-431c-a9f6-e2278d875d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.799230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a2c28-8b77-431c-a9f6-e2278d875d96 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.831495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 951/1915] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:41 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:41.835317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5ed83-fc50-46c9-8c83-0e76f479c8ed admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.848654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5ed83-fc50-46c9-8c83-0e76f479c8ed admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.856312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1633-f9a6-47cb-846e-cb7b550392e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.857557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1633-f9a6-47cb-846e-cb7b550392e3 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.858027 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1633-f9a6-47cb-846e-cb7b550392e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.858514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc1633-f9a6-47cb-846e-cb7b550392e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.860285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc1633-f9a6-47cb-846e-cb7b550392e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.862277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc1633-f9a6-47cb-846e-cb7b550392e3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.878519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 965/1916] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:41.882598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a2c28-8b77-431c-a9f6-e2278d875d96 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.893396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a2c28-8b77-431c-a9f6-e2278d875d96 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.900225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c01af-7d8c-484c-9124-daee2d6d3357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.901341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c01af-7d8c-484c-9124-daee2d6d3357 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.901747 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c01af-7d8c-484c-9124-daee2d6d3357 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.901991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c01af-7d8c-484c-9124-daee2d6d3357 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.902906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c01af-7d8c-484c-9124-daee2d6d3357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.904806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c01af-7d8c-484c-9124-daee2d6d3357 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.921483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 952/1917] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:41.922314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1633-f9a6-47cb-846e-cb7b550392e3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:41.933625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc1633-f9a6-47cb-846e-cb7b550392e3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:41.938564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe76526-8904-4742-b3ef-8f4497f91a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:41.939468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe76526-8904-4742-b3ef-8f4497f91a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.939783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe76526-8904-4742-b3ef-8f4497f91a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.940066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe76526-8904-4742-b3ef-8f4497f91a34 admin admin] PATH_INFO: `/v3/projects/8dc0e9534ccf4f5b940aec37b8bb2a95/users/c2fdbbccc07e492e9c17bfeb7da63cc7/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:41.959982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe76526-8904-4742-b3ef-8f4497f91a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dc0e9534ccf4f5b940aec37b8bb2a95, user_id=c2fdbbccc07e492e9c17bfeb7da63cc7, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:41.964903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe76526-8904-4742-b3ef-8f4497f91a34 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:41.986217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 966/1918] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:41 2022] PUT /identity/v3/projects/8dc0e9534ccf4f5b940aec37b8bb2a95/users/c2fdbbccc07e492e9c17bfeb7da63cc7/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:41.998335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52112d65-6726-416e-8788-a282f2869c6d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:41.998736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52112d65-6726-416e-8788-a282f2869c6d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:41.999200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52112d65-6726-416e-8788-a282f2869c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:42.031991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-52112d65-6726-416e-8788-a282f2869c6d None None] MFA Rules not processed for user `c2fdbbccc07e492e9c17bfeb7da63cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:42.033401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-52112d65-6726-416e-8788-a282f2869c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:42.123937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 953/1919] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:42.135209 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe76526-8904-4742-b3ef-8f4497f91a34 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:42.136970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5fe76526-8904-4742-b3ef-8f4497f91a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:42.203195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe76526-8904-4742-b3ef-8f4497f91a34 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:42.207490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fff65-1f99-47a9-80f5-ca0c1e4cad23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:42.208227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fff65-1f99-47a9-80f5-ca0c1e4cad23 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:42.208689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fff65-1f99-47a9-80f5-ca0c1e4cad23 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:42.209239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fff65-1f99-47a9-80f5-ca0c1e4cad23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:42.219667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fff65-1f99-47a9-80f5-ca0c1e4cad23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:42.221101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fff65-1f99-47a9-80f5-ca0c1e4cad23 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:42.230932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 967/1920] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:45.516771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52112d65-6726-416e-8788-a282f2869c6d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:45.597362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52112d65-6726-416e-8788-a282f2869c6d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:45.605089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:45.606369 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:45.606803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:45.607233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] PATH_INFO: `/v3/users/c2fdbbccc07e492e9c17bfeb7da63cc7` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:45.608929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2fdbbccc07e492e9c17bfeb7da63cc7)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:45.612750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:45.672385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2fdbbccc07e492e9c17bfeb7da63cc7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:45.683469 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2fdbbccc07e492e9c17bfeb7da63cc7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:45.684372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2fdbbccc07e492e9c17bfeb7da63cc7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:45.696013 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2fdbbccc07e492e9c17bfeb7da63cc7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:45.704035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2fdbbccc07e492e9c17bfeb7da63cc7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:45.715349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 954/1921] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:45 2022] DELETE /identity/v3/users/c2fdbbccc07e492e9c17bfeb7da63cc7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:45.717336 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328d867-6a2d-4ef2-aed3-620a1639f131 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:45.718285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328d867-6a2d-4ef2-aed3-620a1639f131 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:45.718646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328d867-6a2d-4ef2-aed3-620a1639f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:45.740020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-c328d867-6a2d-4ef2-aed3-620a1639f131 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:45.741368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c328d867-6a2d-4ef2-aed3-620a1639f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:45.810367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 968/1922] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:45.831191 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:45.833027 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:45.893892 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a04b16-beff-4c32-876d-8cb6646688b5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:45.900884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51290483-546f-446e-b0bc-1871669c6fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:45.901998 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290483-546f-446e-b0bc-1871669c6fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:45.902445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290483-546f-446e-b0bc-1871669c6fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:45.902897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51290483-546f-446e-b0bc-1871669c6fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:45.913728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51290483-546f-446e-b0bc-1871669c6fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:45.915173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51290483-546f-446e-b0bc-1871669c6fc7 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:45.933584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 955/1923] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:47.135873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328d867-6a2d-4ef2-aed3-620a1639f131 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:47.141112 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c328d867-6a2d-4ef2-aed3-620a1639f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:47.157032 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328d867-6a2d-4ef2-aed3-620a1639f131 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:47.171466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:47.172518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.172811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.173096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] PATH_INFO: `/v3/projects/8dc0e9534ccf4f5b940aec37b8bb2a95` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.175766 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dc0e9534ccf4f5b940aec37b8bb2a95)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:47.178937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:47.232484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dc0e9534ccf4f5b940aec37b8bb2a95', 'request_id': 'req-c986d441-6bca-469c-997a-414310f0c52a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.239180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dc0e9534ccf4f5b940aec37b8bb2a95', 'request_id': 'req-c986d441-6bca-469c-997a-414310f0c52a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.252269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dc0e9534ccf4f5b940aec37b8bb2a95', 'request_id': 'req-c986d441-6bca-469c-997a-414310f0c52a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.267316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] The token cache is being invalidate because project 8dc0e9534ccf4f5b940aec37b8bb2a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:47.267686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.268788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.270849 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 969/1924] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:47 2022] DELETE /identity/v3/projects/8dc0e9534ccf4f5b940aec37b8bb2a95 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:47.277069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e6c75-3fa9-423c-a2f8-294cc97db871 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.277645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e6c75-3fa9-423c-a2f8-294cc97db871 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.277645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e6c75-3fa9-423c-a2f8-294cc97db871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.297738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c37e6c75-3fa9-423c-a2f8-294cc97db871 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:47.298967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c37e6c75-3fa9-423c-a2f8-294cc97db871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:47.334213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:47.337939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:47.393500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 956/1925] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:47.403285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7238-3114-4247-9eb7-df52a47a9d18 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.404143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7238-3114-4247-9eb7-df52a47a9d18 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.404513 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b7238-3114-4247-9eb7-df52a47a9d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.422709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986d441-6bca-469c-997a-414310f0c52a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:47.426574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-788b7238-3114-4247-9eb7-df52a47a9d18 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:47.429474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-788b7238-3114-4247-9eb7-df52a47a9d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:47.432571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:47.433848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.434341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.434622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] PATH_INFO: `/v3/users/50f28bb145bd408994b9e96b8b826dd3` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.435945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f28bb145bd408994b9e96b8b826dd3)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:47.438077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:47.440684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 957/1926] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:47.447098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7238-3114-4247-9eb7-df52a47a9d18 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:47.477451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b7238-3114-4247-9eb7-df52a47a9d18 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:47.484388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30ca57-9921-43a2-9077-34fa837d362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:47.485061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30ca57-9921-43a2-9077-34fa837d362e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.485346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30ca57-9921-43a2-9077-34fa837d362e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.485624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30ca57-9921-43a2-9077-34fa837d362e admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.486359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30ca57-9921-43a2-9077-34fa837d362e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:47.486838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30ca57-9921-43a2-9077-34fa837d362e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:47.488629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30ca57-9921-43a2-9077-34fa837d362e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:47.515077 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 958/1927] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:49:47.516229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30ca57-9921-43a2-9077-34fa837d362e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:47.529372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30ca57-9921-43a2-9077-34fa837d362e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:47.534124 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40c073-28dd-4d4b-82f4-78d8198e4bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:47.535093 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c073-28dd-4d4b-82f4-78d8198e4bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.535599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c073-28dd-4d4b-82f4-78d8198e4bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.536073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40c073-28dd-4d4b-82f4-78d8198e4bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.537002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c073-28dd-4d4b-82f4-78d8198e4bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:47.540006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f28bb145bd408994b9e96b8b826dd3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.540846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40c073-28dd-4d4b-82f4-78d8198e4bb3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:47.556918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f28bb145bd408994b9e96b8b826dd3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.572925 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f28bb145bd408994b9e96b8b826dd3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.580475 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 959/1928] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:47 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:47.584662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40c073-28dd-4d4b-82f4-78d8198e4bb3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:47.585546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f28bb145bd408994b9e96b8b826dd3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.586686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f07a9560-2946-4369-a129-1fcd34580e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f28bb145bd408994b9e96b8b826dd3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:47.601761 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 970/1929] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:47 2022] DELETE /identity/v3/users/50f28bb145bd408994b9e96b8b826dd3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:47.606478 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165d9c2-224c-4695-b3f1-b6ab805a0118 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.606770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165d9c2-224c-4695-b3f1-b6ab805a0118 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.607380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165d9c2-224c-4695-b3f1-b6ab805a0118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.630115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3165d9c2-224c-4695-b3f1-b6ab805a0118 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:47.632666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3165d9c2-224c-4695-b3f1-b6ab805a0118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:47.673606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40c073-28dd-4d4b-82f4-78d8198e4bb3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:47.737444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 971/1930] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:47.747306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165d9c2-224c-4695-b3f1-b6ab805a0118 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:47.749316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3165d9c2-224c-4695-b3f1-b6ab805a0118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:47.755161 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47664b-e6bd-4510-957b-6b0924e021eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:47.756019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47664b-e6bd-4510-957b-6b0924e021eb admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.756303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47664b-e6bd-4510-957b-6b0924e021eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.756579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47664b-e6bd-4510-957b-6b0924e021eb admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.757480 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47664b-e6bd-4510-957b-6b0924e021eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:47.760774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47664b-e6bd-4510-957b-6b0924e021eb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:47.797787 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 960/1931] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:47 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:47.799043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47664b-e6bd-4510-957b-6b0924e021eb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:47.801248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cb47664b-e6bd-4510-957b-6b0924e021eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:47.820106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47664b-e6bd-4510-957b-6b0924e021eb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:47.827592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d64f2-5cc3-4eea-b8ed-8fad8e7e0ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:47.828484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d64f2-5cc3-4eea-b8ed-8fad8e7e0ecb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.828934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d64f2-5cc3-4eea-b8ed-8fad8e7e0ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.829503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d64f2-5cc3-4eea-b8ed-8fad8e7e0ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.830686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d64f2-5cc3-4eea-b8ed-8fad8e7e0ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:47.833773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d64f2-5cc3-4eea-b8ed-8fad8e7e0ecb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:47.834687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165d9c2-224c-4695-b3f1-b6ab805a0118 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:47.839719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8461f47-b120-463e-b5ae-c168c4ef115b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:47.840382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8461f47-b120-463e-b5ae-c168c4ef115b service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.840830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8461f47-b120-463e-b5ae-c168c4ef115b service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.841124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8461f47-b120-463e-b5ae-c168c4ef115b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.849586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 961/1932] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:47.853012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8461f47-b120-463e-b5ae-c168c4ef115b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:47.853198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d64f2-5cc3-4eea-b8ed-8fad8e7e0ecb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:47.853566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8461f47-b120-463e-b5ae-c168c4ef115b service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:47.867769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d64f2-5cc3-4eea-b8ed-8fad8e7e0ecb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:47.875487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 972/1933] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:49:47.877182 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5dfe10-f198-42ed-9bb5-8647b6f702aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:47.878036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dfe10-f198-42ed-9bb5-8647b6f702aa admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.878316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dfe10-f198-42ed-9bb5-8647b6f702aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.878589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5dfe10-f198-42ed-9bb5-8647b6f702aa admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.879341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dfe10-f198-42ed-9bb5-8647b6f702aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:47.881272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5dfe10-f198-42ed-9bb5-8647b6f702aa admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:47.903523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 962/1934] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:49:47.907887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8461f47-b120-463e-b5ae-c168c4ef115b service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:47.924353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8461f47-b120-463e-b5ae-c168c4ef115b service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:47.932178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a826ff7-dc83-4679-b749-744bbd661903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:47.933576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826ff7-dc83-4679-b749-744bbd661903 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:47.934308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826ff7-dc83-4679-b749-744bbd661903 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:47.934604 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a826ff7-dc83-4679-b749-744bbd661903 admin admin] PATH_INFO: `/v3/projects/83bc84b8e4264295a93590a6ca6040e3/users/e2affcea661f4a3b9f0b5306f01a9e6d/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:47.959091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a826ff7-dc83-4679-b749-744bbd661903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bc84b8e4264295a93590a6ca6040e3, user_id=e2affcea661f4a3b9f0b5306f01a9e6d, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:47.963315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a826ff7-dc83-4679-b749-744bbd661903 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:47.998160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 973/1935] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:47 2022] PUT /identity/v3/projects/83bc84b8e4264295a93590a6ca6040e3/users/e2affcea661f4a3b9f0b5306f01a9e6d/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:48.002573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bcac8-af71-4300-b64b-2e4edd703552 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:48.002899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bcac8-af71-4300-b64b-2e4edd703552 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:48.003192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bcac8-af71-4300-b64b-2e4edd703552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:48.044534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6a7bcac8-af71-4300-b64b-2e4edd703552 None None] MFA Rules not processed for user `e2affcea661f4a3b9f0b5306f01a9e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:48.046942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6a7bcac8-af71-4300-b64b-2e4edd703552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:48.150811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 963/1936] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:48.163101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a826ff7-dc83-4679-b749-744bbd661903 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:48.165048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9a826ff7-dc83-4679-b749-744bbd661903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:48.260397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a826ff7-dc83-4679-b749-744bbd661903 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:48.278083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747158d-1fd1-4897-acfc-d68e3c6c261c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:48.278770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747158d-1fd1-4897-acfc-d68e3c6c261c service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:48.279059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747158d-1fd1-4897-acfc-d68e3c6c261c service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:48.279344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747158d-1fd1-4897-acfc-d68e3c6c261c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:48.294003 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747158d-1fd1-4897-acfc-d68e3c6c261c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:48.295482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747158d-1fd1-4897-acfc-d68e3c6c261c service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:48.311587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 974/1937] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:48.553257 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bcac8-af71-4300-b64b-2e4edd703552 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:48.569938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6a7bcac8-af71-4300-b64b-2e4edd703552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:48.697186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bcac8-af71-4300-b64b-2e4edd703552 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:48.702756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:48.703849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:48.704357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:48.704783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] PATH_INFO: `/v3/projects/55033e40da5a48ada384102acbbc029b` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:48.706661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55033e40da5a48ada384102acbbc029b)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:48.709434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:48.834227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55033e40da5a48ada384102acbbc029b', 'request_id': 'req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:48.850825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55033e40da5a48ada384102acbbc029b', 'request_id': 'req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:48.865260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55033e40da5a48ada384102acbbc029b', 'request_id': 'req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:48.878236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] The token cache is being invalidate because project 55033e40da5a48ada384102acbbc029b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:48.878692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:48.879701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:48.881785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 964/1938] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:48 2022] DELETE /identity/v3/projects/55033e40da5a48ada384102acbbc029b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:48.886863 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747158d-1fd1-4897-acfc-d68e3c6c261c service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:48.905121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747158d-1fd1-4897-acfc-d68e3c6c261c service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:48.970982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:48.972592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:48.972592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:48.973119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] PATH_INFO: `/v3/users/55929c61f4154ba19206ecd2c9683b08` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:48.974248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=55929c61f4154ba19206ecd2c9683b08)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:48.976310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:49.032082 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55929c61f4154ba19206ecd2c9683b08'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.039333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55929c61f4154ba19206ecd2c9683b08'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.058439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55929c61f4154ba19206ecd2c9683b08'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.066095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55929c61f4154ba19206ecd2c9683b08'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.066780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-e1ec7d34-bb2a-486f-897e-bf63c8c139fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55929c61f4154ba19206ecd2c9683b08'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.073500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 975/1939] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:48 2022] DELETE /identity/v3/users/55929c61f4154ba19206ecd2c9683b08 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:49.368487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:49.370837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:49.383499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2b52b-e3dc-4094-ac3b-de44b4321ea2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:49.447748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:49.448686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:49.449022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:49.449341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] PATH_INFO: `/v3/projects/66c4e341476145bfbca51547620639d8` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:49.450689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c4e341476145bfbca51547620639d8)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:49.452736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:49.507626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c4e341476145bfbca51547620639d8', 'request_id': 'req-4b2f785b-b919-4fb8-acca-97ff21bb43f4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.517384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c4e341476145bfbca51547620639d8', 'request_id': 'req-4b2f785b-b919-4fb8-acca-97ff21bb43f4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.524302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c4e341476145bfbca51547620639d8', 'request_id': 'req-4b2f785b-b919-4fb8-acca-97ff21bb43f4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.537359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] The token cache is being invalidate because project 66c4e341476145bfbca51547620639d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:49.537645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.538293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2f785b-b919-4fb8-acca-97ff21bb43f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:49.543669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 965/1940] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:49 2022] DELETE /identity/v3/projects/66c4e341476145bfbca51547620639d8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:49.547706 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d2b7b-5a32-40ce-8638-d1d4551eb41c None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:49.548179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d2b7b-5a32-40ce-8638-d1d4551eb41c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:49.548396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d2b7b-5a32-40ce-8638-d1d4551eb41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:49.568600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-092d2b7b-5a32-40ce-8638-d1d4551eb41c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:49.569955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-092d2b7b-5a32-40ce-8638-d1d4551eb41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:49.643607 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 976/1941] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:49.647240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cebce-c924-4a69-808a-76c35167e0dd None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:49.647722 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cebce-c924-4a69-808a-76c35167e0dd None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:49.647958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cebce-c924-4a69-808a-76c35167e0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:49.668661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-277cebce-c924-4a69-808a-76c35167e0dd None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:49.669892 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-277cebce-c924-4a69-808a-76c35167e0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:49.678276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 966/1942] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:49.682933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d2b7b-5a32-40ce-8638-d1d4551eb41c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:49.692433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d2b7b-5a32-40ce-8638-d1d4551eb41c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:49.697724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c95e-438a-49f5-8401-c2caba79cf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:49.699008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c95e-438a-49f5-8401-c2caba79cf55 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:49.699243 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c95e-438a-49f5-8401-c2caba79cf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:49.699530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93c95e-438a-49f5-8401-c2caba79cf55 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:49.700324 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93c95e-438a-49f5-8401-c2caba79cf55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:49.700637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93c95e-438a-49f5-8401-c2caba79cf55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:49.702242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93c95e-438a-49f5-8401-c2caba79cf55 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:49.718253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 977/1943] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:49:49.719676 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cebce-c924-4a69-808a-76c35167e0dd None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:49.730617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cebce-c924-4a69-808a-76c35167e0dd None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:49.735320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de6add-fba8-4d92-a68d-e27d94235b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:49.736040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de6add-fba8-4d92-a68d-e27d94235b2b admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:49.736332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de6add-fba8-4d92-a68d-e27d94235b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:49.736612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de6add-fba8-4d92-a68d-e27d94235b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:49.737334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de6add-fba8-4d92-a68d-e27d94235b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:49.739244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de6add-fba8-4d92-a68d-e27d94235b2b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:49.766215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 967/1944] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:49 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:49.770932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c95e-438a-49f5-8401-c2caba79cf55 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:49.783865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93c95e-438a-49f5-8401-c2caba79cf55 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:49.855749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a0dbc-990a-4de7-9a18-0e725f31e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:49.856432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a0dbc-990a-4de7-9a18-0e725f31e01c admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:49.856716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a0dbc-990a-4de7-9a18-0e725f31e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:49.857032 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a0dbc-990a-4de7-9a18-0e725f31e01c admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:49.857770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a0dbc-990a-4de7-9a18-0e725f31e01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:49.859806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a0dbc-990a-4de7-9a18-0e725f31e01c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:49.895693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 978/1945] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:49 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:49.900443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de6add-fba8-4d92-a68d-e27d94235b2b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:49.912838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de6add-fba8-4d92-a68d-e27d94235b2b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:49.921574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c8cd9-5708-4ad1-8670-2ce2e0c09b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:49.922355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c8cd9-5708-4ad1-8670-2ce2e0c09b91 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:49.922910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c8cd9-5708-4ad1-8670-2ce2e0c09b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:49.923325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c8cd9-5708-4ad1-8670-2ce2e0c09b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:49.924243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c8cd9-5708-4ad1-8670-2ce2e0c09b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:49.927050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c8cd9-5708-4ad1-8670-2ce2e0c09b91 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:49.954446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 968/1946] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:49.958829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a0dbc-990a-4de7-9a18-0e725f31e01c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:49.970274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a0dbc-990a-4de7-9a18-0e725f31e01c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:49.976536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf89db-5aaf-454c-b86a-7afc9971cac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:49.977341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf89db-5aaf-454c-b86a-7afc9971cac2 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:49.979009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf89db-5aaf-454c-b86a-7afc9971cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:49.979889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf89db-5aaf-454c-b86a-7afc9971cac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:49.980860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf89db-5aaf-454c-b86a-7afc9971cac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:49.982985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf89db-5aaf-454c-b86a-7afc9971cac2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:50.014721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 979/1947] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:50.015828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c8cd9-5708-4ad1-8670-2ce2e0c09b91 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:50.030823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c8cd9-5708-4ad1-8670-2ce2e0c09b91 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:50.035510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2959b-c471-4816-891f-adbb409ebc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:50.036427 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2959b-c471-4816-891f-adbb409ebc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.036713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2959b-c471-4816-891f-adbb409ebc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.036995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd2959b-c471-4816-891f-adbb409ebc99 admin admin] PATH_INFO: `/v3/projects/1e3308902162401ebcde03c11bc2f04a/users/cfbbfdb013bc413285e381615872ecbb/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.054648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2959b-c471-4816-891f-adbb409ebc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3308902162401ebcde03c11bc2f04a, user_id=cfbbfdb013bc413285e381615872ecbb, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:50.055031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd2959b-c471-4816-891f-adbb409ebc99 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:50.068345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 969/1948] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:50 2022] PUT /identity/v3/projects/1e3308902162401ebcde03c11bc2f04a/users/cfbbfdb013bc413285e381615872ecbb/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:50.081643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6636fc5-e90f-4654-8aca-1a5be41f4e4a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.082364 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6636fc5-e90f-4654-8aca-1a5be41f4e4a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.082657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6636fc5-e90f-4654-8aca-1a5be41f4e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.118368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d6636fc5-e90f-4654-8aca-1a5be41f4e4a None None] MFA Rules not processed for user `cfbbfdb013bc413285e381615872ecbb`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:50.119666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d6636fc5-e90f-4654-8aca-1a5be41f4e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:50.193251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 980/1949] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:50.198147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2959b-c471-4816-891f-adbb409ebc99 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:50.282283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd2959b-c471-4816-891f-adbb409ebc99 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:50.292331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52c011-3d05-4317-ae10-6292583a5b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:50.293462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c011-3d05-4317-ae10-6292583a5b06 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.293853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c011-3d05-4317-ae10-6292583a5b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.294234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52c011-3d05-4317-ae10-6292583a5b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.295073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52c011-3d05-4317-ae10-6292583a5b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:50.298479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52c011-3d05-4317-ae10-6292583a5b06 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:50.330925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 970/1950] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:50 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:50.335113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6636fc5-e90f-4654-8aca-1a5be41f4e4a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:50.348083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6636fc5-e90f-4654-8aca-1a5be41f4e4a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:50.429235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab3ccd-5c0b-45bf-adbd-77eb2db9d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:50.430014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab3ccd-5c0b-45bf-adbd-77eb2db9d358 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.430298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab3ccd-5c0b-45bf-adbd-77eb2db9d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.430600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab3ccd-5c0b-45bf-adbd-77eb2db9d358 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.431944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab3ccd-5c0b-45bf-adbd-77eb2db9d358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:50.434841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab3ccd-5c0b-45bf-adbd-77eb2db9d358 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:50.461148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 981/1951] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:50 2022] POST /identity/v3/users => generated 300 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:50.461625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52c011-3d05-4317-ae10-6292583a5b06 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:50.474643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52c011-3d05-4317-ae10-6292583a5b06 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:50.480898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15508b8e-dc02-411a-b1eb-6870ba7a3ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:50.481643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15508b8e-dc02-411a-b1eb-6870ba7a3ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.481994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15508b8e-dc02-411a-b1eb-6870ba7a3ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.482409 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15508b8e-dc02-411a-b1eb-6870ba7a3ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.484184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15508b8e-dc02-411a-b1eb-6870ba7a3ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:50.486965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15508b8e-dc02-411a-b1eb-6870ba7a3ea1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:50.511939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 971/1952] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:49:50.516467 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab3ccd-5c0b-45bf-adbd-77eb2db9d358 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:50.528936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab3ccd-5c0b-45bf-adbd-77eb2db9d358 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:50.534671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f4b02-5a09-4f7d-9fb4-9b3496e4b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:50.535737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4b02-5a09-4f7d-9fb4-9b3496e4b118 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.536019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4b02-5a09-4f7d-9fb4-9b3496e4b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.536295 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4b02-5a09-4f7d-9fb4-9b3496e4b118 admin admin] PATH_INFO: `/v3/projects/1a8d6f386d484405b112bb7960a44836/users/e750f2ad036a49bd96b4c6974b8e1789/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.552011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f4b02-5a09-4f7d-9fb4-9b3496e4b118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8d6f386d484405b112bb7960a44836, user_id=e750f2ad036a49bd96b4c6974b8e1789, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:50.554756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f4b02-5a09-4f7d-9fb4-9b3496e4b118 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:50.569768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 982/1953] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:50 2022] PUT /identity/v3/projects/1a8d6f386d484405b112bb7960a44836/users/e750f2ad036a49bd96b4c6974b8e1789/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:49:50.574667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15508b8e-dc02-411a-b1eb-6870ba7a3ea1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:50.589044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15508b8e-dc02-411a-b1eb-6870ba7a3ea1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:50.656608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8937d-7dfa-482d-be95-8384413f7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:50.657305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8937d-7dfa-482d-be95-8384413f7cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.657681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8937d-7dfa-482d-be95-8384413f7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.658216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8937d-7dfa-482d-be95-8384413f7cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.659834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8937d-7dfa-482d-be95-8384413f7cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:50.661577 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8937d-7dfa-482d-be95-8384413f7cf1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:50.675658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 972/1954] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:50.676910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f4b02-5a09-4f7d-9fb4-9b3496e4b118 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:50.688130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f4b02-5a09-4f7d-9fb4-9b3496e4b118 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:50.694507 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca45341-0133-4ee1-9232-3d0eed7731d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:50.695462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca45341-0133-4ee1-9232-3d0eed7731d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.695669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca45341-0133-4ee1-9232-3d0eed7731d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.695951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca45341-0133-4ee1-9232-3d0eed7731d9 admin admin] PATH_INFO: `/v3/projects/1a8d6f386d484405b112bb7960a44836/users/e750f2ad036a49bd96b4c6974b8e1789/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.698044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca45341-0133-4ee1-9232-3d0eed7731d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8d6f386d484405b112bb7960a44836, user_id=e750f2ad036a49bd96b4c6974b8e1789, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:50.700728 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca45341-0133-4ee1-9232-3d0eed7731d9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:50.712915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 983/1955] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:50 2022] PUT /identity/v3/projects/1a8d6f386d484405b112bb7960a44836/users/e750f2ad036a49bd96b4c6974b8e1789/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:50.733498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48967f-c75c-4972-8272-921481bc9c56 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.733498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48967f-c75c-4972-8272-921481bc9c56 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.733498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48967f-c75c-4972-8272-921481bc9c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.764621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6f48967f-c75c-4972-8272-921481bc9c56 None None] MFA Rules not processed for user `e750f2ad036a49bd96b4c6974b8e1789`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:50.765859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6f48967f-c75c-4972-8272-921481bc9c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:50.834636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 973/1956] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:50.845109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca45341-0133-4ee1-9232-3d0eed7731d9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:50.846791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2ca45341-0133-4ee1-9232-3d0eed7731d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:50.905627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca45341-0133-4ee1-9232-3d0eed7731d9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:50.909423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617bc4f-f5f2-48dd-a39e-78c62f7c0d63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:50.910085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617bc4f-f5f2-48dd-a39e-78c62f7c0d63 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:50.910373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617bc4f-f5f2-48dd-a39e-78c62f7c0d63 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:50.910652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617bc4f-f5f2-48dd-a39e-78c62f7c0d63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:50.920997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617bc4f-f5f2-48dd-a39e-78c62f7c0d63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:50.922469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617bc4f-f5f2-48dd-a39e-78c62f7c0d63 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:50.934921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 984/1957] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:50.965082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48967f-c75c-4972-8272-921481bc9c56 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:51.029649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48967f-c75c-4972-8272-921481bc9c56 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:51.034606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:51.036425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:51.036740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:51.037021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] PATH_INFO: `/v3/users/cfbbfdb013bc413285e381615872ecbb` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:51.038279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbbfdb013bc413285e381615872ecbb)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:51.040615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:51.093903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbbfdb013bc413285e381615872ecbb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.102545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbbfdb013bc413285e381615872ecbb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.104150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbbfdb013bc413285e381615872ecbb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.124128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbbfdb013bc413285e381615872ecbb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.132361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbbfdb013bc413285e381615872ecbb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.140874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 974/1958] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:50 2022] DELETE /identity/v3/users/cfbbfdb013bc413285e381615872ecbb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:51.145416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915a20-7af5-4464-9336-5888cfe9df05 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:51.145787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915a20-7af5-4464-9336-5888cfe9df05 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:51.146142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51915a20-7af5-4464-9336-5888cfe9df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:51.166051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-51915a20-7af5-4464-9336-5888cfe9df05 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:51.167289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-51915a20-7af5-4464-9336-5888cfe9df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:51.227021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 985/1959] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:49:51.237692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:51.239479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:51.305719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168f125-f522-4a31-9a0b-c654953bde6f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:51.309567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf0cfd-d650-43bd-8f39-d7e55f9c39a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:51.310215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf0cfd-d650-43bd-8f39-d7e55f9c39a0 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:51.310502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf0cfd-d650-43bd-8f39-d7e55f9c39a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:51.310776 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf0cfd-d650-43bd-8f39-d7e55f9c39a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:51.321155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf0cfd-d650-43bd-8f39-d7e55f9c39a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:51.323174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf0cfd-d650-43bd-8f39-d7e55f9c39a0 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:51.336805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 975/1960] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:51.669319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915a20-7af5-4464-9336-5888cfe9df05 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:51.671551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-51915a20-7af5-4464-9336-5888cfe9df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:51.689004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51915a20-7af5-4464-9336-5888cfe9df05 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:51.697930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:51.699126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:51.699617 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:51.700589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] PATH_INFO: `/v3/projects/1e3308902162401ebcde03c11bc2f04a` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:51.702210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3308902162401ebcde03c11bc2f04a)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:51.704301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:51.774670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3308902162401ebcde03c11bc2f04a', 'request_id': 'req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.780942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3308902162401ebcde03c11bc2f04a', 'request_id': 'req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.786385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3308902162401ebcde03c11bc2f04a', 'request_id': 'req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.805281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] The token cache is being invalidate because project 1e3308902162401ebcde03c11bc2f04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:51.806296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.807091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.808960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 986/1961] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:51 2022] DELETE /identity/v3/projects/1e3308902162401ebcde03c11bc2f04a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:51.812848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf0cfd-d650-43bd-8f39-d7e55f9c39a0 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:51.827982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf0cfd-d650-43bd-8f39-d7e55f9c39a0 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:51.891471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:51.892500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:51.892859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:51.893315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] PATH_INFO: `/v3/users/e750f2ad036a49bd96b4c6974b8e1789` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:51.894613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e750f2ad036a49bd96b4c6974b8e1789)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:51.896720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:51.956247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e750f2ad036a49bd96b4c6974b8e1789'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.964875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e750f2ad036a49bd96b4c6974b8e1789'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.965901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e750f2ad036a49bd96b4c6974b8e1789'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:51.985806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e750f2ad036a49bd96b4c6974b8e1789'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:52.000887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-513a2689-9912-4b30-add3-dd019b4d82b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e750f2ad036a49bd96b4c6974b8e1789'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:52.007165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 976/1962] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:51 2022] DELETE /identity/v3/users/e750f2ad036a49bd96b4c6974b8e1789 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:52.299526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:52.301066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:52.315451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb07ff1-5444-4c71-b8a3-7094f2fa2b9e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:52.385022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:52.386332 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.386619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.386895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] PATH_INFO: `/v3/projects/1a8d6f386d484405b112bb7960a44836` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.388121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8d6f386d484405b112bb7960a44836)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:52.390075 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:52.437363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8d6f386d484405b112bb7960a44836', 'request_id': 'req-bc25e347-00d7-456d-94b9-16bbc81d7378'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:52.445214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8d6f386d484405b112bb7960a44836', 'request_id': 'req-bc25e347-00d7-456d-94b9-16bbc81d7378'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:52.450611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8d6f386d484405b112bb7960a44836', 'request_id': 'req-bc25e347-00d7-456d-94b9-16bbc81d7378'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:52.463276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] The token cache is being invalidate because project 1a8d6f386d484405b112bb7960a44836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:52.463588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:52.464206 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc25e347-00d7-456d-94b9-16bbc81d7378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:52.465735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 987/1963] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:52 2022] DELETE /identity/v3/projects/1a8d6f386d484405b112bb7960a44836 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:52.472974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c2ebb-35fa-4e56-afe1-abff977886be None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.473265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c2ebb-35fa-4e56-afe1-abff977886be None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.473550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c2ebb-35fa-4e56-afe1-abff977886be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.492204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-527c2ebb-35fa-4e56-afe1-abff977886be None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:52.493499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-527c2ebb-35fa-4e56-afe1-abff977886be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:52.552959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 977/1964] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:52.561377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c33a0-bd6f-4e8f-820d-1af98c5ba40f None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.561668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c33a0-bd6f-4e8f-820d-1af98c5ba40f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.561946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c33a0-bd6f-4e8f-820d-1af98c5ba40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.581333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b43c33a0-bd6f-4e8f-820d-1af98c5ba40f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:52.582590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b43c33a0-bd6f-4e8f-820d-1af98c5ba40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:52.591199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 988/1965] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:52.595709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c2ebb-35fa-4e56-afe1-abff977886be None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:52.607171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c2ebb-35fa-4e56-afe1-abff977886be None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:52.611830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f257ad-fc1f-4a15-8d84-520fd20cb9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:52.612521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f257ad-fc1f-4a15-8d84-520fd20cb9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.612845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f257ad-fc1f-4a15-8d84-520fd20cb9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.613127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f257ad-fc1f-4a15-8d84-520fd20cb9c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.613882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f257ad-fc1f-4a15-8d84-520fd20cb9c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:52.614175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f257ad-fc1f-4a15-8d84-520fd20cb9c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:52.615914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f257ad-fc1f-4a15-8d84-520fd20cb9c5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:52.629253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 978/1966] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:49:52.632224 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c33a0-bd6f-4e8f-820d-1af98c5ba40f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:52.641506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c33a0-bd6f-4e8f-820d-1af98c5ba40f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:52.646731 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268e15f-69e7-4ce8-85e4-b8add733606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:52.647386 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268e15f-69e7-4ce8-85e4-b8add733606d admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.647797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268e15f-69e7-4ce8-85e4-b8add733606d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.648079 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268e15f-69e7-4ce8-85e4-b8add733606d admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.649086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268e15f-69e7-4ce8-85e4-b8add733606d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:52.651746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268e15f-69e7-4ce8-85e4-b8add733606d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:52.684241 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 989/1967] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:52 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:52.685483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f257ad-fc1f-4a15-8d84-520fd20cb9c5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:52.696303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f257ad-fc1f-4a15-8d84-520fd20cb9c5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:52.757661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349461a-c74b-4ce0-ac1c-accbc6381c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:52.758386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349461a-c74b-4ce0-ac1c-accbc6381c87 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.758706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349461a-c74b-4ce0-ac1c-accbc6381c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.759020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349461a-c74b-4ce0-ac1c-accbc6381c87 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.759949 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349461a-c74b-4ce0-ac1c-accbc6381c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:52.761866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349461a-c74b-4ce0-ac1c-accbc6381c87 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:52.789272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 979/1968] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:52 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:52.794326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268e15f-69e7-4ce8-85e4-b8add733606d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:52.807092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268e15f-69e7-4ce8-85e4-b8add733606d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:52.811948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfe489-e56d-4bed-9120-5bb8f8e6f938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:52.812724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfe489-e56d-4bed-9120-5bb8f8e6f938 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.813300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfe489-e56d-4bed-9120-5bb8f8e6f938 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.813594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfe489-e56d-4bed-9120-5bb8f8e6f938 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.814342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfe489-e56d-4bed-9120-5bb8f8e6f938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:52.816557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfe489-e56d-4bed-9120-5bb8f8e6f938 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:52.827915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 990/1969] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:52.831920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349461a-c74b-4ce0-ac1c-accbc6381c87 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:52.842078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349461a-c74b-4ce0-ac1c-accbc6381c87 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:52.846641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439246d6-a9f9-4224-8958-aeef06300849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:52.847302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439246d6-a9f9-4224-8958-aeef06300849 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.847612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439246d6-a9f9-4224-8958-aeef06300849 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.847897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439246d6-a9f9-4224-8958-aeef06300849 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.848636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439246d6-a9f9-4224-8958-aeef06300849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:52.850214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439246d6-a9f9-4224-8958-aeef06300849 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:52.860748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 980/1970] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:52.865027 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfe489-e56d-4bed-9120-5bb8f8e6f938 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:52.875747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfe489-e56d-4bed-9120-5bb8f8e6f938 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:52.880497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03878564-3cb8-4458-91e5-94afb35c0e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:52.881373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03878564-3cb8-4458-91e5-94afb35c0e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.881888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03878564-3cb8-4458-91e5-94afb35c0e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.882206 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03878564-3cb8-4458-91e5-94afb35c0e81 admin admin] PATH_INFO: `/v3/projects/9e1d7fa7477f446990e53e5023bf1779/users/fed4590ceb2a4e149b7a43578af377c0/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.897648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03878564-3cb8-4458-91e5-94afb35c0e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1d7fa7477f446990e53e5023bf1779, user_id=fed4590ceb2a4e149b7a43578af377c0, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:52.901337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03878564-3cb8-4458-91e5-94afb35c0e81 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:52.914067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 991/1971] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:52 2022] PUT /identity/v3/projects/9e1d7fa7477f446990e53e5023bf1779/users/fed4590ceb2a4e149b7a43578af377c0/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:52.927695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acfd08-e802-4b4c-a9c6-783e76bfc89b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:52.928122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acfd08-e802-4b4c-a9c6-783e76bfc89b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:52.928414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acfd08-e802-4b4c-a9c6-783e76bfc89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:52.954973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b2acfd08-e802-4b4c-a9c6-783e76bfc89b None None] MFA Rules not processed for user `fed4590ceb2a4e149b7a43578af377c0`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:52.956275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b2acfd08-e802-4b4c-a9c6-783e76bfc89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:53.026590 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 981/1972] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:53.037339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03878564-3cb8-4458-91e5-94afb35c0e81 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:53.039885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-03878564-3cb8-4458-91e5-94afb35c0e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:53.103428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03878564-3cb8-4458-91e5-94afb35c0e81 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:53.107555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63794617-dfa4-4522-94d7-bcbee3b7e5ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:53.108306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794617-dfa4-4522-94d7-bcbee3b7e5ef service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:53.108660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794617-dfa4-4522-94d7-bcbee3b7e5ef service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:53.108970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63794617-dfa4-4522-94d7-bcbee3b7e5ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:53.118601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63794617-dfa4-4522-94d7-bcbee3b7e5ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:53.120514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63794617-dfa4-4522-94d7-bcbee3b7e5ef service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:53.129630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 992/1973] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:55.709819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acfd08-e802-4b4c-a9c6-783e76bfc89b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:55.786175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acfd08-e802-4b4c-a9c6-783e76bfc89b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:55.790815 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:55.791826 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:55.792212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:55.792553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] PATH_INFO: `/v3/users/fed4590ceb2a4e149b7a43578af377c0` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:55.794314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed4590ceb2a4e149b7a43578af377c0)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:55.796376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:55.845024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed4590ceb2a4e149b7a43578af377c0'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:55.851709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed4590ceb2a4e149b7a43578af377c0'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:55.853194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed4590ceb2a4e149b7a43578af377c0'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:55.864883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed4590ceb2a4e149b7a43578af377c0'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:55.873377 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed4590ceb2a4e149b7a43578af377c0'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:55.883534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 982/1974] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:49:55 2022] DELETE /identity/v3/users/fed4590ceb2a4e149b7a43578af377c0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:55.888316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30100a-acde-4661-8f59-f9aadfdf274c None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:55.888759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30100a-acde-4661-8f59-f9aadfdf274c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:55.888991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30100a-acde-4661-8f59-f9aadfdf274c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:55.907994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3d30100a-acde-4661-8f59-f9aadfdf274c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:55.909645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3d30100a-acde-4661-8f59-f9aadfdf274c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:55.988091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 993/1975] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:56.001730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:56.003761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:56.061478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2a369-8745-4b42-88c0-d9e5a59d2ab4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:56.065295 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d729a6f-0833-4b30-bddb-1f4731fe40f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:56.065849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d729a6f-0833-4b30-bddb-1f4731fe40f8 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.066315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d729a6f-0833-4b30-bddb-1f4731fe40f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.066433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d729a6f-0833-4b30-bddb-1f4731fe40f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.076393 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d729a6f-0833-4b30-bddb-1f4731fe40f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:56.077842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d729a6f-0833-4b30-bddb-1f4731fe40f8 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:56.087422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 983/1976] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:49:56.357107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30100a-acde-4661-8f59-f9aadfdf274c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:56.358645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3d30100a-acde-4661-8f59-f9aadfdf274c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:56.371219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30100a-acde-4661-8f59-f9aadfdf274c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:56.375967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:56.376836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.377138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.377971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] PATH_INFO: `/v3/projects/9e1d7fa7477f446990e53e5023bf1779` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.379399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1d7fa7477f446990e53e5023bf1779)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:56.381565 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:56.428655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1d7fa7477f446990e53e5023bf1779', 'request_id': 'req-3fdcb704-a6eb-4928-a147-a69c623583f1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:56.434798 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1d7fa7477f446990e53e5023bf1779', 'request_id': 'req-3fdcb704-a6eb-4928-a147-a69c623583f1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:56.440296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1d7fa7477f446990e53e5023bf1779', 'request_id': 'req-3fdcb704-a6eb-4928-a147-a69c623583f1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:56.453856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] The token cache is being invalidate because project 9e1d7fa7477f446990e53e5023bf1779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:49:56.454156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:56.454781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-3fdcb704-a6eb-4928-a147-a69c623583f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:49:56.461130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 994/1977] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:49:56 2022] DELETE /identity/v3/projects/9e1d7fa7477f446990e53e5023bf1779 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:56.463621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be159b0-fc5b-49cd-902f-e73ecbef977d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.463923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be159b0-fc5b-49cd-902f-e73ecbef977d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.464208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be159b0-fc5b-49cd-902f-e73ecbef977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.483350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2be159b0-fc5b-49cd-902f-e73ecbef977d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:56.484646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2be159b0-fc5b-49cd-902f-e73ecbef977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:56.571786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 984/1978] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:56.572030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67392be2-923d-49f1-9fea-ab3003c23602 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.572030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67392be2-923d-49f1-9fea-ab3003c23602 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.572030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67392be2-923d-49f1-9fea-ab3003c23602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.592388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-67392be2-923d-49f1-9fea-ab3003c23602 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:56.593609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-67392be2-923d-49f1-9fea-ab3003c23602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:56.601586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 995/1979] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:56.607355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be159b0-fc5b-49cd-902f-e73ecbef977d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:56.616834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be159b0-fc5b-49cd-902f-e73ecbef977d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:56.622132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10634ed6-3572-41bf-b0a8-048bd8c5c7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:56.622799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634ed6-3572-41bf-b0a8-048bd8c5c7ee admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.623083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634ed6-3572-41bf-b0a8-048bd8c5c7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.623363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10634ed6-3572-41bf-b0a8-048bd8c5c7ee admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.624142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10634ed6-3572-41bf-b0a8-048bd8c5c7ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:49:56.624452 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10634ed6-3572-41bf-b0a8-048bd8c5c7ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:56.626133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10634ed6-3572-41bf-b0a8-048bd8c5c7ee admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:56.639345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 985/1980] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:49:56.654390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67392be2-923d-49f1-9fea-ab3003c23602 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:56.660122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67392be2-923d-49f1-9fea-ab3003c23602 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:56.666832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d998-ce09-4f95-94ee-168c82bb1cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:56.667404 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d998-ce09-4f95-94ee-168c82bb1cdf admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.667811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d998-ce09-4f95-94ee-168c82bb1cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.668180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0d998-ce09-4f95-94ee-168c82bb1cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.668999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0d998-ce09-4f95-94ee-168c82bb1cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:56.671257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0d998-ce09-4f95-94ee-168c82bb1cdf admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:56.701255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 996/1981] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:49:56 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:49:56.705380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10634ed6-3572-41bf-b0a8-048bd8c5c7ee admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:56.722924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10634ed6-3572-41bf-b0a8-048bd8c5c7ee admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:56.791714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c84a5e-b9dc-42ac-85a9-6801ef345a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:56.792388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c84a5e-b9dc-42ac-85a9-6801ef345a43 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.792670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c84a5e-b9dc-42ac-85a9-6801ef345a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.792947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c84a5e-b9dc-42ac-85a9-6801ef345a43 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.793670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c84a5e-b9dc-42ac-85a9-6801ef345a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:56.795592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c84a5e-b9dc-42ac-85a9-6801ef345a43 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:56.815629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 986/1982] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:49:56 2022] POST /identity/v3/users => generated 300 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:49:56.819426 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d998-ce09-4f95-94ee-168c82bb1cdf admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:56.829394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0d998-ce09-4f95-94ee-168c82bb1cdf admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:56.834255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec73c3-53d2-4b4b-a3d0-6b9a1a13eb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:56.834911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec73c3-53d2-4b4b-a3d0-6b9a1a13eb95 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.835194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec73c3-53d2-4b4b-a3d0-6b9a1a13eb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.835491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec73c3-53d2-4b4b-a3d0-6b9a1a13eb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.836252 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec73c3-53d2-4b4b-a3d0-6b9a1a13eb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:56.837987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec73c3-53d2-4b4b-a3d0-6b9a1a13eb95 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:56.847988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 997/1983] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:56.851778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c84a5e-b9dc-42ac-85a9-6801ef345a43 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:56.862773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c84a5e-b9dc-42ac-85a9-6801ef345a43 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:56.867232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d981a-25de-4cfb-9bc2-274861172842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:56.868019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d981a-25de-4cfb-9bc2-274861172842 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.868955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d981a-25de-4cfb-9bc2-274861172842 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.869397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d981a-25de-4cfb-9bc2-274861172842 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.870166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d981a-25de-4cfb-9bc2-274861172842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:56.871799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d981a-25de-4cfb-9bc2-274861172842 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:56.882394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 987/1984] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:49:56.887184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec73c3-53d2-4b4b-a3d0-6b9a1a13eb95 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:56.900244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec73c3-53d2-4b4b-a3d0-6b9a1a13eb95 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:56.905820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e841bd-f853-43f8-bd72-3ec33ab58ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:56.906869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e841bd-f853-43f8-bd72-3ec33ab58ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.907106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e841bd-f853-43f8-bd72-3ec33ab58ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.907382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e841bd-f853-43f8-bd72-3ec33ab58ba0 admin admin] PATH_INFO: `/v3/projects/c11a203308cf42dcb4102e1c254b53eb/users/43780ee11deb40ffb7361ea7a8f87d6a/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.924506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e841bd-f853-43f8-bd72-3ec33ab58ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c11a203308cf42dcb4102e1c254b53eb, user_id=43780ee11deb40ffb7361ea7a8f87d6a, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:56.927264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e841bd-f853-43f8-bd72-3ec33ab58ba0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:56.940755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 998/1985] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:49:56 2022] PUT /identity/v3/projects/c11a203308cf42dcb4102e1c254b53eb/users/43780ee11deb40ffb7361ea7a8f87d6a/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:49:56.956613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2376c-dd8b-40b1-9560-0e2bf872b8b2 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:56.956929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2376c-dd8b-40b1-9560-0e2bf872b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:56.957212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2376c-dd8b-40b1-9560-0e2bf872b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:56.984156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6fd2376c-dd8b-40b1-9560-0e2bf872b8b2 None None] MFA Rules not processed for user `43780ee11deb40ffb7361ea7a8f87d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:49:56.985350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6fd2376c-dd8b-40b1-9560-0e2bf872b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:57.048177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 988/1986] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:49:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:49:57.058327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e841bd-f853-43f8-bd72-3ec33ab58ba0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:49:57.060057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f1e841bd-f853-43f8-bd72-3ec33ab58ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:49:57.114385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e841bd-f853-43f8-bd72-3ec33ab58ba0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:49:57.117992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da35fd-9203-4d50-8038-04e47a920a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:49:57.118706 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da35fd-9203-4d50-8038-04e47a920a10 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:49:57.118997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da35fd-9203-4d50-8038-04e47a920a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:49:57.119279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da35fd-9203-4d50-8038-04e47a920a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:49:57.127395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da35fd-9203-4d50-8038-04e47a920a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:49:57.128933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da35fd-9203-4d50-8038-04e47a920a10 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:49:57.137654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 999/1987] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:49:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:01.499663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2376c-dd8b-40b1-9560-0e2bf872b8b2 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:01.499663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6fd2376c-dd8b-40b1-9560-0e2bf872b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:01.567039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2376c-dd8b-40b1-9560-0e2bf872b8b2 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:01.572779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:01.573726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:01.574014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:01.574289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] PATH_INFO: `/v3/users/fe12b69fda1e4bb0953ec32f2f8d4864` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:01.575547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe12b69fda1e4bb0953ec32f2f8d4864)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:01.577482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:01.620874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe12b69fda1e4bb0953ec32f2f8d4864'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.627478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe12b69fda1e4bb0953ec32f2f8d4864'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.628180 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe12b69fda1e4bb0953ec32f2f8d4864'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.639980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe12b69fda1e4bb0953ec32f2f8d4864'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.646630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-8800f541-6b5b-4be5-a995-76ad185ac316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe12b69fda1e4bb0953ec32f2f8d4864'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.652777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 989/1988] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:01 2022] DELETE /identity/v3/users/fe12b69fda1e4bb0953ec32f2f8d4864 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:01.821756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da35fd-9203-4d50-8038-04e47a920a10 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:01.832688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da35fd-9203-4d50-8038-04e47a920a10 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:01.886864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:01.887756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:01.888039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:01.888314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] PATH_INFO: `/v3/projects/8930d227a39349b8a900ed8395fb7d2b` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:01.889563 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8930d227a39349b8a900ed8395fb7d2b)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:01.891448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:01.935956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8930d227a39349b8a900ed8395fb7d2b', 'request_id': 'req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.941975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8930d227a39349b8a900ed8395fb7d2b', 'request_id': 'req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.948067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8930d227a39349b8a900ed8395fb7d2b', 'request_id': 'req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.959803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] The token cache is being invalidate because project 8930d227a39349b8a900ed8395fb7d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:01.960093 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.960723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b75a7eea-d316-48a5-bd9d-7d8a6030cc7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:01.962916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1000/1989] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:01 2022] DELETE /identity/v3/projects/8930d227a39349b8a900ed8395fb7d2b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:01.974851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81623bee-7b32-41a5-a363-e94264e23ea1 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:01.975143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81623bee-7b32-41a5-a363-e94264e23ea1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:01.975426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81623bee-7b32-41a5-a363-e94264e23ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:01.993420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-81623bee-7b32-41a5-a363-e94264e23ea1 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:01.994628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-81623bee-7b32-41a5-a363-e94264e23ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:02.051188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 990/1990] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:02.060008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa836597-0546-4e2b-b24e-05d3705907e8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.060321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa836597-0546-4e2b-b24e-05d3705907e8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.060602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa836597-0546-4e2b-b24e-05d3705907e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.079005 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-fa836597-0546-4e2b-b24e-05d3705907e8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:02.080213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-fa836597-0546-4e2b-b24e-05d3705907e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:02.088842 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1001/1991] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:02.093022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81623bee-7b32-41a5-a363-e94264e23ea1 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.102467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81623bee-7b32-41a5-a363-e94264e23ea1 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.106973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3583f8d-fed2-4da5-8843-538b720fff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.107658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3583f8d-fed2-4da5-8843-538b720fff50 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.107950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3583f8d-fed2-4da5-8843-538b720fff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.108230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3583f8d-fed2-4da5-8843-538b720fff50 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.108968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3583f8d-fed2-4da5-8843-538b720fff50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:02.109277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3583f8d-fed2-4da5-8843-538b720fff50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.110867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3583f8d-fed2-4da5-8843-538b720fff50 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.122305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 991/1992] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:50:02.126468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa836597-0546-4e2b-b24e-05d3705907e8 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.136246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa836597-0546-4e2b-b24e-05d3705907e8 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.140850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e55d-1523-4977-a9ca-b46801b317b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.141509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e55d-1523-4977-a9ca-b46801b317b0 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.141794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e55d-1523-4977-a9ca-b46801b317b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.142074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e55d-1523-4977-a9ca-b46801b317b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.142864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106e55d-1523-4977-a9ca-b46801b317b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.144880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106e55d-1523-4977-a9ca-b46801b317b0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.170454 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1002/1993] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:02 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:02.174643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3583f8d-fed2-4da5-8843-538b720fff50 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.185072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3583f8d-fed2-4da5-8843-538b720fff50 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.238718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d9569-e206-44c5-9b83-2ed0d8e106b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.239329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d9569-e206-44c5-9b83-2ed0d8e106b5 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.239626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d9569-e206-44c5-9b83-2ed0d8e106b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.239918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d9569-e206-44c5-9b83-2ed0d8e106b5 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.240679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d9569-e206-44c5-9b83-2ed0d8e106b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.243107 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d9569-e206-44c5-9b83-2ed0d8e106b5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.267217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 992/1994] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:02 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:02.268720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e55d-1523-4977-a9ca-b46801b317b0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.279984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e55d-1523-4977-a9ca-b46801b317b0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.284588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4ef1-af5b-4cfd-9424-9fc3a42ba3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.285244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4ef1-af5b-4cfd-9424-9fc3a42ba3bf admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.285557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4ef1-af5b-4cfd-9424-9fc3a42ba3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.285835 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac4ef1-af5b-4cfd-9424-9fc3a42ba3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.286570 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac4ef1-af5b-4cfd-9424-9fc3a42ba3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.288185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac4ef1-af5b-4cfd-9424-9fc3a42ba3bf admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.302583 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1003/1995] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:02.304256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d9569-e206-44c5-9b83-2ed0d8e106b5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.314736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d9569-e206-44c5-9b83-2ed0d8e106b5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.319606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c32d14-3170-4ff9-8ccd-a7d593aede64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.320365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32d14-3170-4ff9-8ccd-a7d593aede64 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.320746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32d14-3170-4ff9-8ccd-a7d593aede64 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.321102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c32d14-3170-4ff9-8ccd-a7d593aede64 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.321849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c32d14-3170-4ff9-8ccd-a7d593aede64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.323556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c32d14-3170-4ff9-8ccd-a7d593aede64 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.335623 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 993/1996] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:02.339314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4ef1-af5b-4cfd-9424-9fc3a42ba3bf admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.349263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac4ef1-af5b-4cfd-9424-9fc3a42ba3bf admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.354686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677870c3-9c11-4f31-a251-32f4ad8f52ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.355586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677870c3-9c11-4f31-a251-32f4ad8f52ff admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.355884 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677870c3-9c11-4f31-a251-32f4ad8f52ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.356166 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677870c3-9c11-4f31-a251-32f4ad8f52ff admin admin] PATH_INFO: `/v3/projects/6bdde242b42a40ccb3ba5a5e699f8701/users/eed8f2f3ef0e4fa19b51c7ac845b4f75/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.370156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677870c3-9c11-4f31-a251-32f4ad8f52ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bdde242b42a40ccb3ba5a5e699f8701, user_id=eed8f2f3ef0e4fa19b51c7ac845b4f75, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.372847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677870c3-9c11-4f31-a251-32f4ad8f52ff admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.385239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1004/1997] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:02 2022] PUT /identity/v3/projects/6bdde242b42a40ccb3ba5a5e699f8701/users/eed8f2f3ef0e4fa19b51c7ac845b4f75/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:02.395207 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b052-fdbc-4512-8d1d-8189145fa31c None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.395496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b052-fdbc-4512-8d1d-8189145fa31c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.395812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6b052-fdbc-4512-8d1d-8189145fa31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.423752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a6b6b052-fdbc-4512-8d1d-8189145fa31c None None] MFA Rules not processed for user `eed8f2f3ef0e4fa19b51c7ac845b4f75`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:02.424950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a6b6b052-fdbc-4512-8d1d-8189145fa31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:02.486035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 994/1998] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:02.490564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677870c3-9c11-4f31-a251-32f4ad8f52ff admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.549692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677870c3-9c11-4f31-a251-32f4ad8f52ff admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.554536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e104-86ca-4760-8767-695418b8814c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.555251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e104-86ca-4760-8767-695418b8814c admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.555560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e104-86ca-4760-8767-695418b8814c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.555941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef49e104-86ca-4760-8767-695418b8814c admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.556720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e104-86ca-4760-8767-695418b8814c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.558615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef49e104-86ca-4760-8767-695418b8814c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.582851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1005/1999] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:02 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:50:02.587052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b052-fdbc-4512-8d1d-8189145fa31c None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.597529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6b052-fdbc-4512-8d1d-8189145fa31c None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.652467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d881d-6a18-4844-8f1d-2415f30e7240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.653406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d881d-6a18-4844-8f1d-2415f30e7240 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.653691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d881d-6a18-4844-8f1d-2415f30e7240 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.653971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d881d-6a18-4844-8f1d-2415f30e7240 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.654713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d881d-6a18-4844-8f1d-2415f30e7240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.656667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d881d-6a18-4844-8f1d-2415f30e7240 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.676355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 995/2000] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:02 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:02.680943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e104-86ca-4760-8767-695418b8814c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.691000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef49e104-86ca-4760-8767-695418b8814c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.696045 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edf11-ff11-4499-8ad6-b6084d64939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.696716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edf11-ff11-4499-8ad6-b6084d64939d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.697002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edf11-ff11-4499-8ad6-b6084d64939d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.697289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857edf11-ff11-4499-8ad6-b6084d64939d admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.698033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edf11-ff11-4499-8ad6-b6084d64939d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.699665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857edf11-ff11-4499-8ad6-b6084d64939d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.709960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1006/2001] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:02.714168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d881d-6a18-4844-8f1d-2415f30e7240 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.725369 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d881d-6a18-4844-8f1d-2415f30e7240 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.731264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e7f9f-efcd-4187-b80d-4f7a44d3d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.732209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e7f9f-efcd-4187-b80d-4f7a44d3d09c admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.732495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e7f9f-efcd-4187-b80d-4f7a44d3d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.732773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e7f9f-efcd-4187-b80d-4f7a44d3d09c admin admin] PATH_INFO: `/v3/projects/26b98a807e1f4c5ab435fd7d9d6b0bc5/users/d1f1e59bd0c641e990205b747422bbc4/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.748564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e7f9f-efcd-4187-b80d-4f7a44d3d09c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b98a807e1f4c5ab435fd7d9d6b0bc5, user_id=d1f1e59bd0c641e990205b747422bbc4, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.751147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e7f9f-efcd-4187-b80d-4f7a44d3d09c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.763431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 996/2002] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:02 2022] PUT /identity/v3/projects/26b98a807e1f4c5ab435fd7d9d6b0bc5/users/d1f1e59bd0c641e990205b747422bbc4/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:02.767443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edf11-ff11-4499-8ad6-b6084d64939d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.777243 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857edf11-ff11-4499-8ad6-b6084d64939d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.830562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e9a4f-3641-4fb8-ba4e-c3c6ac439e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.831219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e9a4f-3641-4fb8-ba4e-c3c6ac439e59 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.831505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e9a4f-3641-4fb8-ba4e-c3c6ac439e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.831816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e9a4f-3641-4fb8-ba4e-c3c6ac439e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.832554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e9a4f-3641-4fb8-ba4e-c3c6ac439e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.834175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e9a4f-3641-4fb8-ba4e-c3c6ac439e59 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.844047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1007/2003] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:02.848211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e7f9f-efcd-4187-b80d-4f7a44d3d09c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.859098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e7f9f-efcd-4187-b80d-4f7a44d3d09c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:02.863988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41603178-d6f5-4e82-9926-8d06d7ccefea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:02.864868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41603178-d6f5-4e82-9926-8d06d7ccefea admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.865155 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41603178-d6f5-4e82-9926-8d06d7ccefea admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.865439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41603178-d6f5-4e82-9926-8d06d7ccefea admin admin] PATH_INFO: `/v3/projects/26b98a807e1f4c5ab435fd7d9d6b0bc5/users/d1f1e59bd0c641e990205b747422bbc4/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.867414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41603178-d6f5-4e82-9926-8d06d7ccefea admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b98a807e1f4c5ab435fd7d9d6b0bc5, user_id=d1f1e59bd0c641e990205b747422bbc4, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:02.870798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41603178-d6f5-4e82-9926-8d06d7ccefea admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:02.880913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 997/2004] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:02 2022] PUT /identity/v3/projects/26b98a807e1f4c5ab435fd7d9d6b0bc5/users/d1f1e59bd0c641e990205b747422bbc4/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:02.891121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3bc7-fc3f-4f73-aa78-815f3ec50ed8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:02.891416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3bc7-fc3f-4f73-aa78-815f3ec50ed8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:02.891735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3bc7-fc3f-4f73-aa78-815f3ec50ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:02.919240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-256b3bc7-fc3f-4f73-aa78-815f3ec50ed8 None None] MFA Rules not processed for user `d1f1e59bd0c641e990205b747422bbc4`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:02.920566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-256b3bc7-fc3f-4f73-aa78-815f3ec50ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:02.986928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1008/2005] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:02.997724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41603178-d6f5-4e82-9926-8d06d7ccefea admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:02.999470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-41603178-d6f5-4e82-9926-8d06d7ccefea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:03.054512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41603178-d6f5-4e82-9926-8d06d7ccefea admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:03.058209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16109994-0c07-4316-b768-287f1ea85656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:03.058850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16109994-0c07-4316-b768-287f1ea85656 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:03.059135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16109994-0c07-4316-b768-287f1ea85656 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:03.059415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16109994-0c07-4316-b768-287f1ea85656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:03.068096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16109994-0c07-4316-b768-287f1ea85656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:03.069517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16109994-0c07-4316-b768-287f1ea85656 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:03.078579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 998/2006] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:03.121398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b3bc7-fc3f-4f73-aa78-815f3ec50ed8 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:03.131200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b3bc7-fc3f-4f73-aa78-815f3ec50ed8 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:03.135152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297bf7d-6459-4b3f-8806-03fad54da62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:03.135824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297bf7d-6459-4b3f-8806-03fad54da62f service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:03.136113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297bf7d-6459-4b3f-8806-03fad54da62f service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:03.136392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297bf7d-6459-4b3f-8806-03fad54da62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:03.192748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297bf7d-6459-4b3f-8806-03fad54da62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:03.194185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297bf7d-6459-4b3f-8806-03fad54da62f service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:03.202867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1009/2007] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:05.309984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5bcd6-ca0d-4fc1-aa96-eab357505176 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:05.310570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5bcd6-ca0d-4fc1-aa96-eab357505176 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:05.310570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5bcd6-ca0d-4fc1-aa96-eab357505176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:05.328323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-51f5bcd6-ca0d-4fc1-aa96-eab357505176 None None] MFA Rules not processed for user `3cfe4a71879849b581eb8b48b24107fd`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:05.329648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-51f5bcd6-ca0d-4fc1-aa96-eab357505176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:05.389142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 999/2008] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:06.639949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297bf7d-6459-4b3f-8806-03fad54da62f service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:06.706234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297bf7d-6459-4b3f-8806-03fad54da62f service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:06.711008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:06.711931 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:06.712215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:06.712492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] PATH_INFO: `/v3/users/eed8f2f3ef0e4fa19b51c7ac845b4f75` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:06.713687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed8f2f3ef0e4fa19b51c7ac845b4f75)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:06.715614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:06.765262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed8f2f3ef0e4fa19b51c7ac845b4f75'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:06.772264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed8f2f3ef0e4fa19b51c7ac845b4f75'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:06.785195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed8f2f3ef0e4fa19b51c7ac845b4f75'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:06.793986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed8f2f3ef0e4fa19b51c7ac845b4f75'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:06.794758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed8f2f3ef0e4fa19b51c7ac845b4f75'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:06.803365 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1010/2009] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:06 2022] DELETE /identity/v3/users/eed8f2f3ef0e4fa19b51c7ac845b4f75 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:06.808687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1da66f-931b-40ea-a95a-6c566d148e9e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:06.809220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1da66f-931b-40ea-a95a-6c566d148e9e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:06.809398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1da66f-931b-40ea-a95a-6c566d148e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:06.828100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2d1da66f-931b-40ea-a95a-6c566d148e9e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:06.829574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2d1da66f-931b-40ea-a95a-6c566d148e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:06.893439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1000/2010] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:06.903751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:06.905622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:06.962514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a1f86-0139-4fe9-ad5b-3d2b4b2e2d27 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:06.966074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0833f1-c115-43d8-b612-450f6fdd3ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:06.966728 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0833f1-c115-43d8-b612-450f6fdd3ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:06.967008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0833f1-c115-43d8-b612-450f6fdd3ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:06.967287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0833f1-c115-43d8-b612-450f6fdd3ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:06.976413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0833f1-c115-43d8-b612-450f6fdd3ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:06.978174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0833f1-c115-43d8-b612-450f6fdd3ee4 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:06.988071 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1011/2011] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:07.266920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1da66f-931b-40ea-a95a-6c566d148e9e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:07.268649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2d1da66f-931b-40ea-a95a-6c566d148e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:07.282946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1da66f-931b-40ea-a95a-6c566d148e9e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:07.287694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:07.288612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:07.288923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:07.289753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] PATH_INFO: `/v3/projects/6bdde242b42a40ccb3ba5a5e699f8701` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:07.291228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bdde242b42a40ccb3ba5a5e699f8701)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:07.296015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:07.348958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bdde242b42a40ccb3ba5a5e699f8701', 'request_id': 'req-c2db550e-d7f9-44aa-af26-a553d7713c3e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.358507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bdde242b42a40ccb3ba5a5e699f8701', 'request_id': 'req-c2db550e-d7f9-44aa-af26-a553d7713c3e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.366126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bdde242b42a40ccb3ba5a5e699f8701', 'request_id': 'req-c2db550e-d7f9-44aa-af26-a553d7713c3e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.378539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] The token cache is being invalidate because project 6bdde242b42a40ccb3ba5a5e699f8701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:07.378989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.379772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.381427 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1001/2012] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:07 2022] DELETE /identity/v3/projects/6bdde242b42a40ccb3ba5a5e699f8701 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:07.386521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0833f1-c115-43d8-b612-450f6fdd3ee4 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:07.396592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0833f1-c115-43d8-b612-450f6fdd3ee4 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:07.461160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:07.462409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:07.462779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:07.463067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] PATH_INFO: `/v3/users/d1f1e59bd0c641e990205b747422bbc4` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:07.464408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f1e59bd0c641e990205b747422bbc4)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:07.466302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:07.466557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:07.467979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:07.482834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db550e-d7f9-44aa-af26-a553d7713c3e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:07.487976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:07.488946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:07.489443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:07.489791 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] PATH_INFO: `/v3/users/43780ee11deb40ffb7361ea7a8f87d6a` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:07.491323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43780ee11deb40ffb7361ea7a8f87d6a)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:07.494532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:07.532813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f1e59bd0c641e990205b747422bbc4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.555164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f1e59bd0c641e990205b747422bbc4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.560523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43780ee11deb40ffb7361ea7a8f87d6a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.568308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43780ee11deb40ffb7361ea7a8f87d6a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.569183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f1e59bd0c641e990205b747422bbc4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.572843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43780ee11deb40ffb7361ea7a8f87d6a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.579468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f1e59bd0c641e990205b747422bbc4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.580455 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784c3fb2-6f1e-4ebc-a5c3-70bd9016a777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f1e59bd0c641e990205b747422bbc4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.591269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1012/2013] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:07 2022] DELETE /identity/v3/users/d1f1e59bd0c641e990205b747422bbc4 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:07.592783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43780ee11deb40ffb7361ea7a8f87d6a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.604107 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43780ee11deb40ffb7361ea7a8f87d6a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:07.616424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1002/2014] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:07 2022] DELETE /identity/v3/users/43780ee11deb40ffb7361ea7a8f87d6a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:07.621044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc82e-cc42-4870-a068-0ba63ccbf6fb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:07.621500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc82e-cc42-4870-a068-0ba63ccbf6fb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:07.621794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383dc82e-cc42-4870-a068-0ba63ccbf6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:07.644593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-383dc82e-cc42-4870-a068-0ba63ccbf6fb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:07.645852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-383dc82e-cc42-4870-a068-0ba63ccbf6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:07.748223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1013/2015] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:07.769229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:07.770775 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:07.834526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc5768-799b-4df2-b7e5-e71d21037968 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:07.839438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad68a-9e87-4c68-98b3-d47c7d3bdc41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:07.840133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad68a-9e87-4c68-98b3-d47c7d3bdc41 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:07.840422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad68a-9e87-4c68-98b3-d47c7d3bdc41 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:07.840704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad68a-9e87-4c68-98b3-d47c7d3bdc41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:07.851250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ad68a-9e87-4c68-98b3-d47c7d3bdc41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:07.853511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ad68a-9e87-4c68-98b3-d47c7d3bdc41 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:07.864290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1003/2016] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:08.142861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc82e-cc42-4870-a068-0ba63ccbf6fb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:08.145168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-383dc82e-cc42-4870-a068-0ba63ccbf6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:08.181189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383dc82e-cc42-4870-a068-0ba63ccbf6fb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:08.198048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:08.199323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:08.199916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:08.200407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] PATH_INFO: `/v3/projects/26b98a807e1f4c5ab435fd7d9d6b0bc5` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:08.211824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b98a807e1f4c5ab435fd7d9d6b0bc5)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:08.221461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:08.300450 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b98a807e1f4c5ab435fd7d9d6b0bc5', 'request_id': 'req-5b5e12a8-eb1a-4d8b-8eda-414815198045'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.314103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b98a807e1f4c5ab435fd7d9d6b0bc5', 'request_id': 'req-5b5e12a8-eb1a-4d8b-8eda-414815198045'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.322125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b98a807e1f4c5ab435fd7d9d6b0bc5', 'request_id': 'req-5b5e12a8-eb1a-4d8b-8eda-414815198045'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.342511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] The token cache is being invalidate because project 26b98a807e1f4c5ab435fd7d9d6b0bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:08.342964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.344552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.347862 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1014/2017] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:08 2022] DELETE /identity/v3/projects/26b98a807e1f4c5ab435fd7d9d6b0bc5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:08.353435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c953217-4c81-462d-a79a-97d080f5eaec None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:08.353942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c953217-4c81-462d-a79a-97d080f5eaec None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:08.354417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c953217-4c81-462d-a79a-97d080f5eaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:08.376988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-5c953217-4c81-462d-a79a-97d080f5eaec None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:08.378924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5c953217-4c81-462d-a79a-97d080f5eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:08.447189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:08.449059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:08.456422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1004/2018] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:08.466359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e7c3a-31c6-4d55-889d-e4e60a94470b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:08.466902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e7c3a-31c6-4d55-889d-e4e60a94470b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:08.467370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e7c3a-31c6-4d55-889d-e4e60a94470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:08.472750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e12a8-eb1a-4d8b-8eda-414815198045 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:08.500158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:08.500158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:08.500158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:08.500158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] PATH_INFO: `/v3/projects/c11a203308cf42dcb4102e1c254b53eb` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:08.502262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c11a203308cf42dcb4102e1c254b53eb)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:08.506589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:08.510335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-517e7c3a-31c6-4d55-889d-e4e60a94470b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:08.512721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-517e7c3a-31c6-4d55-889d-e4e60a94470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:08.523102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1005/2019] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:08.528021 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e7c3a-31c6-4d55-889d-e4e60a94470b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:08.548809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e7c3a-31c6-4d55-889d-e4e60a94470b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:08.562595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9073df-670b-4e16-b5bb-31ab3d553c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:08.563337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9073df-670b-4e16-b5bb-31ab3d553c98 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:08.563654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9073df-670b-4e16-b5bb-31ab3d553c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:08.563938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9073df-670b-4e16-b5bb-31ab3d553c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:08.567516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9073df-670b-4e16-b5bb-31ab3d553c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:08.567771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9073df-670b-4e16-b5bb-31ab3d553c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:08.569733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9073df-670b-4e16-b5bb-31ab3d553c98 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:08.585870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1006/2020] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:50:08.590283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9073df-670b-4e16-b5bb-31ab3d553c98 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:08.619479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9073df-670b-4e16-b5bb-31ab3d553c98 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:08.651668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c11a203308cf42dcb4102e1c254b53eb', 'request_id': 'req-bc491e27-af1d-4558-9a9f-8c072c4ef067'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.664024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c11a203308cf42dcb4102e1c254b53eb', 'request_id': 'req-bc491e27-af1d-4558-9a9f-8c072c4ef067'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.681831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c11a203308cf42dcb4102e1c254b53eb', 'request_id': 'req-bc491e27-af1d-4558-9a9f-8c072c4ef067'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.705796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] The token cache is being invalidate because project c11a203308cf42dcb4102e1c254b53eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:08.706092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.707749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:08.710576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1015/2021] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:08 2022] DELETE /identity/v3/projects/c11a203308cf42dcb4102e1c254b53eb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:08.747975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8207eb7-2e4c-4e72-9d17-06ca4ec463d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:08.748920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8207eb7-2e4c-4e72-9d17-06ca4ec463d3 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:08.749368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8207eb7-2e4c-4e72-9d17-06ca4ec463d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:08.749855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8207eb7-2e4c-4e72-9d17-06ca4ec463d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:08.750819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8207eb7-2e4c-4e72-9d17-06ca4ec463d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:08.754047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8207eb7-2e4c-4e72-9d17-06ca4ec463d3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:08.795610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1007/2022] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:08 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:50:08.797150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:08.799175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:08.817067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc491e27-af1d-4558-9a9f-8c072c4ef067 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:08.886414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9487-687e-454d-95d4-f2792af0cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:08.887240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9487-687e-454d-95d4-f2792af0cde8 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:08.887658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9487-687e-454d-95d4-f2792af0cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:08.888063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9487-687e-454d-95d4-f2792af0cde8 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:08.888888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f9487-687e-454d-95d4-f2792af0cde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:08.891204 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f9487-687e-454d-95d4-f2792af0cde8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:08.915200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1016/2023] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:08 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:50:08.919559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8207eb7-2e4c-4e72-9d17-06ca4ec463d3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:08.930642 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8207eb7-2e4c-4e72-9d17-06ca4ec463d3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:08.935722 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def5ee8-c18a-48b1-9f08-604c49679ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:08.936438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def5ee8-c18a-48b1-9f08-604c49679ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:08.936727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def5ee8-c18a-48b1-9f08-604c49679ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:08.937011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def5ee8-c18a-48b1-9f08-604c49679ee3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:08.937758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def5ee8-c18a-48b1-9f08-604c49679ee3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:08.939996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def5ee8-c18a-48b1-9f08-604c49679ee3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:08.951203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1008/2024] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:50:08.955237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9487-687e-454d-95d4-f2792af0cde8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:08.965714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9487-687e-454d-95d4-f2792af0cde8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:08.970210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c19b1a-409f-45ec-80b6-a422c529bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:08.970868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c19b1a-409f-45ec-80b6-a422c529bf4e admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:08.971151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c19b1a-409f-45ec-80b6-a422c529bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:08.971431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c19b1a-409f-45ec-80b6-a422c529bf4e admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:08.972232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c19b1a-409f-45ec-80b6-a422c529bf4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:08.973903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c19b1a-409f-45ec-80b6-a422c529bf4e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:08.985611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1017/2025] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:08.989878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def5ee8-c18a-48b1-9f08-604c49679ee3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:09.000154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def5ee8-c18a-48b1-9f08-604c49679ee3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:09.005005 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aeeb3-1db2-4037-9ae3-c8dc5a7dcbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:09.005903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aeeb3-1db2-4037-9ae3-c8dc5a7dcbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.006188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aeeb3-1db2-4037-9ae3-c8dc5a7dcbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.006468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7aeeb3-1db2-4037-9ae3-c8dc5a7dcbe7 admin admin] PATH_INFO: `/v3/projects/b810c96d99fc4564ad24f6e2bd0d2607/users/a838bacaf37c4945a96635bbef28332f/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.025227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aeeb3-1db2-4037-9ae3-c8dc5a7dcbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b810c96d99fc4564ad24f6e2bd0d2607, user_id=a838bacaf37c4945a96635bbef28332f, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:09.028498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7aeeb3-1db2-4037-9ae3-c8dc5a7dcbe7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:09.052757 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1009/2026] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:08 2022] PUT /identity/v3/projects/b810c96d99fc4564ad24f6e2bd0d2607/users/a838bacaf37c4945a96635bbef28332f/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:09.063276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee65f1-9abe-4d06-9164-63e0f4129fd1 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.063602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee65f1-9abe-4d06-9164-63e0f4129fd1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.063918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee65f1-9abe-4d06-9164-63e0f4129fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.092390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-59ee65f1-9abe-4d06-9164-63e0f4129fd1 None None] MFA Rules not processed for user `a838bacaf37c4945a96635bbef28332f`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:09.093398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-59ee65f1-9abe-4d06-9164-63e0f4129fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:09.173555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1018/2027] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:09.178471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aeeb3-1db2-4037-9ae3-c8dc5a7dcbe7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:09.244581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7aeeb3-1db2-4037-9ae3-c8dc5a7dcbe7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:09.249379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5900ca3-69f4-46e7-ae71-0aa4b03034bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:09.250049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5900ca3-69f4-46e7-ae71-0aa4b03034bc admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.250338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5900ca3-69f4-46e7-ae71-0aa4b03034bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.250615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5900ca3-69f4-46e7-ae71-0aa4b03034bc admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.251343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5900ca3-69f4-46e7-ae71-0aa4b03034bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:09.253291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5900ca3-69f4-46e7-ae71-0aa4b03034bc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:09.286051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1010/2028] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:09 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:09.287147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee65f1-9abe-4d06-9164-63e0f4129fd1 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:09.299062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee65f1-9abe-4d06-9164-63e0f4129fd1 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:09.378061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128f50d-9365-49af-80e7-712009972b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:09.378746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128f50d-9365-49af-80e7-712009972b7e admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.379031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128f50d-9365-49af-80e7-712009972b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.379301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128f50d-9365-49af-80e7-712009972b7e admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.380060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128f50d-9365-49af-80e7-712009972b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:09.381965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128f50d-9365-49af-80e7-712009972b7e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:09.406509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1019/2029] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:09 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:09.407768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5900ca3-69f4-46e7-ae71-0aa4b03034bc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:09.419004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5900ca3-69f4-46e7-ae71-0aa4b03034bc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:09.424080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96f5fb-4add-4505-bfb4-1bce0dfdf022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:09.424788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96f5fb-4add-4505-bfb4-1bce0dfdf022 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.425075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96f5fb-4add-4505-bfb4-1bce0dfdf022 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.425355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96f5fb-4add-4505-bfb4-1bce0dfdf022 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.426095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96f5fb-4add-4505-bfb4-1bce0dfdf022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:09.427734 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96f5fb-4add-4505-bfb4-1bce0dfdf022 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:09.439415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1011/2030] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:09.443872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128f50d-9365-49af-80e7-712009972b7e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:09.454132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128f50d-9365-49af-80e7-712009972b7e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:09.459733 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e220706-7f01-4602-b117-e3260d3ff56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:09.460641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e220706-7f01-4602-b117-e3260d3ff56a admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.460922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e220706-7f01-4602-b117-e3260d3ff56a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.462246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e220706-7f01-4602-b117-e3260d3ff56a admin admin] PATH_INFO: `/v3/projects/69f6cd7e17d8454da2fc89a732e47cf0/users/6b927657665b45c4a0ea4e119fd95ce1/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.476141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e220706-7f01-4602-b117-e3260d3ff56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f6cd7e17d8454da2fc89a732e47cf0, user_id=6b927657665b45c4a0ea4e119fd95ce1, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:09.479330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e220706-7f01-4602-b117-e3260d3ff56a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:09.493282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1020/2031] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:09 2022] PUT /identity/v3/projects/69f6cd7e17d8454da2fc89a732e47cf0/users/6b927657665b45c4a0ea4e119fd95ce1/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:09.500801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96f5fb-4add-4505-bfb4-1bce0dfdf022 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:09.511096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96f5fb-4add-4505-bfb4-1bce0dfdf022 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:09.570810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0b4a-9659-4768-8d5e-b7bfac8afa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:09.571795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0b4a-9659-4768-8d5e-b7bfac8afa5b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.572084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0b4a-9659-4768-8d5e-b7bfac8afa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.572365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0b4a-9659-4768-8d5e-b7bfac8afa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.573113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a0b4a-9659-4768-8d5e-b7bfac8afa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:09.574963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a0b4a-9659-4768-8d5e-b7bfac8afa5b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:09.588964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1012/2032] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:09.590404 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e220706-7f01-4602-b117-e3260d3ff56a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:09.600500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e220706-7f01-4602-b117-e3260d3ff56a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:09.605689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542523f-cc4a-44ff-90a8-f59625a1f92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:09.606563 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542523f-cc4a-44ff-90a8-f59625a1f92b admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.606844 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542523f-cc4a-44ff-90a8-f59625a1f92b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.607120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542523f-cc4a-44ff-90a8-f59625a1f92b admin admin] PATH_INFO: `/v3/projects/69f6cd7e17d8454da2fc89a732e47cf0/users/6b927657665b45c4a0ea4e119fd95ce1/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.609315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542523f-cc4a-44ff-90a8-f59625a1f92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69f6cd7e17d8454da2fc89a732e47cf0, user_id=6b927657665b45c4a0ea4e119fd95ce1, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:09.612207 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542523f-cc4a-44ff-90a8-f59625a1f92b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:09.631610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1021/2033] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:09 2022] PUT /identity/v3/projects/69f6cd7e17d8454da2fc89a732e47cf0/users/6b927657665b45c4a0ea4e119fd95ce1/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:09.636768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282dd9-4118-45c7-9b4f-448627d54f6f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.637065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282dd9-4118-45c7-9b4f-448627d54f6f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.637344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b282dd9-4118-45c7-9b4f-448627d54f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.683072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2b282dd9-4118-45c7-9b4f-448627d54f6f None None] MFA Rules not processed for user `6b927657665b45c4a0ea4e119fd95ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:09.684324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2b282dd9-4118-45c7-9b4f-448627d54f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:09.761014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1013/2034] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:09.767792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542523f-cc4a-44ff-90a8-f59625a1f92b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:09.769522 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2542523f-cc4a-44ff-90a8-f59625a1f92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:09.843542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542523f-cc4a-44ff-90a8-f59625a1f92b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:09.847349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542c694-4c6f-4c38-bfb5-aa5ed2e23e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:09.848194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c694-4c6f-4c38-bfb5-aa5ed2e23e67 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:09.848484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c694-4c6f-4c38-bfb5-aa5ed2e23e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:09.849775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542c694-4c6f-4c38-bfb5-aa5ed2e23e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:09.861325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c694-4c6f-4c38-bfb5-aa5ed2e23e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:09.863063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542c694-4c6f-4c38-bfb5-aa5ed2e23e67 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:09.881734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1022/2035] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:09.952949 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282dd9-4118-45c7-9b4f-448627d54f6f None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:10.019035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b282dd9-4118-45c7-9b4f-448627d54f6f None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:10.023856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:10.024757 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:10.025038 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:10.025314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] PATH_INFO: `/v3/users/a838bacaf37c4945a96635bbef28332f` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:10.026570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a838bacaf37c4945a96635bbef28332f)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:10.028556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:10.077516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a838bacaf37c4945a96635bbef28332f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.084307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a838bacaf37c4945a96635bbef28332f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.085038 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a838bacaf37c4945a96635bbef28332f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.099454 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a838bacaf37c4945a96635bbef28332f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.110090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a838bacaf37c4945a96635bbef28332f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.117005 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1014/2036] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:09 2022] DELETE /identity/v3/users/a838bacaf37c4945a96635bbef28332f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:10.121913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb90885-e447-4d65-83cb-2d497eda9db1 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:10.122301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb90885-e447-4d65-83cb-2d497eda9db1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:10.122644 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb90885-e447-4d65-83cb-2d497eda9db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:10.141574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-deb90885-e447-4d65-83cb-2d497eda9db1 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:10.142902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-deb90885-e447-4d65-83cb-2d497eda9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:10.215856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1023/2037] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:10.234250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:10.235986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:10.305693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ffe71-54dc-4308-9792-85c2bc00f26d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:10.310514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197339-4a9e-48d9-b7e3-91a631920f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:10.311883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197339-4a9e-48d9-b7e3-91a631920f75 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:10.311883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197339-4a9e-48d9-b7e3-91a631920f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:10.311883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197339-4a9e-48d9-b7e3-91a631920f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:10.325073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d197339-4a9e-48d9-b7e3-91a631920f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:10.326691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d197339-4a9e-48d9-b7e3-91a631920f75 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:10.337153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1015/2038] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:10.609702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb90885-e447-4d65-83cb-2d497eda9db1 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:10.611108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-deb90885-e447-4d65-83cb-2d497eda9db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:10.624785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb90885-e447-4d65-83cb-2d497eda9db1 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:10.629685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:10.630589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:10.630869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:10.631140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] PATH_INFO: `/v3/projects/b810c96d99fc4564ad24f6e2bd0d2607` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:10.632368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b810c96d99fc4564ad24f6e2bd0d2607)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:10.635324 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:10.682651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b810c96d99fc4564ad24f6e2bd0d2607', 'request_id': 'req-7569ca7e-6b66-4d81-b9a2-03cc523dd497'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.688789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b810c96d99fc4564ad24f6e2bd0d2607', 'request_id': 'req-7569ca7e-6b66-4d81-b9a2-03cc523dd497'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.694150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b810c96d99fc4564ad24f6e2bd0d2607', 'request_id': 'req-7569ca7e-6b66-4d81-b9a2-03cc523dd497'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.708504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] The token cache is being invalidate because project b810c96d99fc4564ad24f6e2bd0d2607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:10.708799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.709469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.711730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1024/2039] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:10 2022] DELETE /identity/v3/projects/b810c96d99fc4564ad24f6e2bd0d2607 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:10.715662 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197339-4a9e-48d9-b7e3-91a631920f75 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:10.725082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197339-4a9e-48d9-b7e3-91a631920f75 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:10.782821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:10.783688 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:10.783978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:10.784258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] PATH_INFO: `/v3/users/6b927657665b45c4a0ea4e119fd95ce1` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:10.785471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b927657665b45c4a0ea4e119fd95ce1)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:10.787416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:10.835275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b927657665b45c4a0ea4e119fd95ce1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.843273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b927657665b45c4a0ea4e119fd95ce1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.844020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b927657665b45c4a0ea4e119fd95ce1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.855188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b927657665b45c4a0ea4e119fd95ce1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.862216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9a645128-a679-4642-8bb3-980cc2ba4e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b927657665b45c4a0ea4e119fd95ce1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:10.868638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1016/2040] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:10 2022] DELETE /identity/v3/users/6b927657665b45c4a0ea4e119fd95ce1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:11.157994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:11.159478 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:11.175926 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7569ca7e-6b66-4d81-b9a2-03cc523dd497 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:11.236105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:11.236961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.237244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.237557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] PATH_INFO: `/v3/projects/69f6cd7e17d8454da2fc89a732e47cf0` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.238723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69f6cd7e17d8454da2fc89a732e47cf0)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:11.240696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:11.285498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69f6cd7e17d8454da2fc89a732e47cf0', 'request_id': 'req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:11.291525 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69f6cd7e17d8454da2fc89a732e47cf0', 'request_id': 'req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:11.296745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69f6cd7e17d8454da2fc89a732e47cf0', 'request_id': 'req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:11.310281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] The token cache is being invalidate because project 69f6cd7e17d8454da2fc89a732e47cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:11.310569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:11.311214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-538f41b2-80fc-4d5a-a897-301fc9fbe4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:11.312874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1025/2041] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:11 2022] DELETE /identity/v3/projects/69f6cd7e17d8454da2fc89a732e47cf0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:11.318465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61f15-c1ba-4d6e-bff6-c1d9e542e280 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.318938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61f15-c1ba-4d6e-bff6-c1d9e542e280 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.319030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61f15-c1ba-4d6e-bff6-c1d9e542e280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.337405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-fda61f15-c1ba-4d6e-bff6-c1d9e542e280 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:11.338634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-fda61f15-c1ba-4d6e-bff6-c1d9e542e280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:11.399919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1017/2042] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:11.406611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75829cf8-9eaa-460c-b57e-cc5d12130034 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.406899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75829cf8-9eaa-460c-b57e-cc5d12130034 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.407179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75829cf8-9eaa-460c-b57e-cc5d12130034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.425433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-75829cf8-9eaa-460c-b57e-cc5d12130034 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:11.427002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-75829cf8-9eaa-460c-b57e-cc5d12130034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:11.436560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1026/2043] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:11.440780 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61f15-c1ba-4d6e-bff6-c1d9e542e280 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:11.450871 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61f15-c1ba-4d6e-bff6-c1d9e542e280 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:11.455363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80621fd1-d5fa-418d-8c4b-49954032bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:11.456047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80621fd1-d5fa-418d-8c4b-49954032bc8f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.456331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80621fd1-d5fa-418d-8c4b-49954032bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.456607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80621fd1-d5fa-418d-8c4b-49954032bc8f admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.457339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80621fd1-d5fa-418d-8c4b-49954032bc8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:11.457642 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80621fd1-d5fa-418d-8c4b-49954032bc8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:11.459240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80621fd1-d5fa-418d-8c4b-49954032bc8f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:11.470773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1018/2044] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:50:11.475093 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75829cf8-9eaa-460c-b57e-cc5d12130034 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:11.484554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75829cf8-9eaa-460c-b57e-cc5d12130034 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:11.489442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d7ec5-e4c6-4da5-9c4c-47ae9686bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:11.490114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d7ec5-e4c6-4da5-9c4c-47ae9686bba9 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.490403 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d7ec5-e4c6-4da5-9c4c-47ae9686bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.490686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d7ec5-e4c6-4da5-9c4c-47ae9686bba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.491416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d7ec5-e4c6-4da5-9c4c-47ae9686bba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:11.494161 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d7ec5-e4c6-4da5-9c4c-47ae9686bba9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:11.524109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1027/2045] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:11 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:11.528523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80621fd1-d5fa-418d-8c4b-49954032bc8f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:11.538640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80621fd1-d5fa-418d-8c4b-49954032bc8f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:11.595174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c23bdc-a16e-4b48-88e2-06cbf4472cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:11.595888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c23bdc-a16e-4b48-88e2-06cbf4472cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.596171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c23bdc-a16e-4b48-88e2-06cbf4472cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.596455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c23bdc-a16e-4b48-88e2-06cbf4472cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.597177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c23bdc-a16e-4b48-88e2-06cbf4472cd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:11.599478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c23bdc-a16e-4b48-88e2-06cbf4472cd1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:11.621536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1019/2046] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:11 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:11.626799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d7ec5-e4c6-4da5-9c4c-47ae9686bba9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:11.638533 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d7ec5-e4c6-4da5-9c4c-47ae9686bba9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:11.643891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2dbb3-cf76-4fb5-81dd-76e11f559506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:11.644582 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2dbb3-cf76-4fb5-81dd-76e11f559506 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.644870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2dbb3-cf76-4fb5-81dd-76e11f559506 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.645154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2dbb3-cf76-4fb5-81dd-76e11f559506 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.645904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2dbb3-cf76-4fb5-81dd-76e11f559506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:11.647525 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2dbb3-cf76-4fb5-81dd-76e11f559506 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:11.659154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1028/2047] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:11.662945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c23bdc-a16e-4b48-88e2-06cbf4472cd1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:11.673457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c23bdc-a16e-4b48-88e2-06cbf4472cd1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:11.678230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3292c8-f047-463f-a858-1a77886c045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:11.678899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3292c8-f047-463f-a858-1a77886c045a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.679185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3292c8-f047-463f-a858-1a77886c045a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.679465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3292c8-f047-463f-a858-1a77886c045a admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.680993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3292c8-f047-463f-a858-1a77886c045a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:11.682737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3292c8-f047-463f-a858-1a77886c045a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:11.693174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1020/2048] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:50:11.697651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2dbb3-cf76-4fb5-81dd-76e11f559506 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:11.707991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2dbb3-cf76-4fb5-81dd-76e11f559506 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:11.713708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd378922-063e-4c12-8cda-bc5939e25cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:11.714765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd378922-063e-4c12-8cda-bc5939e25cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.715222 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd378922-063e-4c12-8cda-bc5939e25cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.715702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd378922-063e-4c12-8cda-bc5939e25cd4 admin admin] PATH_INFO: `/v3/projects/0b4ddd6f19ed441db1c93f466d10fb92/users/852f71cfb41d4d71b88b010e0f3c28c0/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.734501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd378922-063e-4c12-8cda-bc5939e25cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4ddd6f19ed441db1c93f466d10fb92, user_id=852f71cfb41d4d71b88b010e0f3c28c0, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:11.737599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd378922-063e-4c12-8cda-bc5939e25cd4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:11.760528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1029/2049] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:11 2022] PUT /identity/v3/projects/0b4ddd6f19ed441db1c93f466d10fb92/users/852f71cfb41d4d71b88b010e0f3c28c0/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:11.770556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c90d0-176f-48ce-8b4d-2360a1caeeda None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.770848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c90d0-176f-48ce-8b4d-2360a1caeeda None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.771131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c90d0-176f-48ce-8b4d-2360a1caeeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.803844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c59c90d0-176f-48ce-8b4d-2360a1caeeda None None] MFA Rules not processed for user `852f71cfb41d4d71b88b010e0f3c28c0`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:11.805746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c59c90d0-176f-48ce-8b4d-2360a1caeeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:11.870337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1021/2050] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:11.874849 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd378922-063e-4c12-8cda-bc5939e25cd4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:11.950524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd378922-063e-4c12-8cda-bc5939e25cd4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:11.955841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280787a-fc53-47ac-9690-072e6a279303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:11.956502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280787a-fc53-47ac-9690-072e6a279303 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:11.956789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280787a-fc53-47ac-9690-072e6a279303 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:11.957195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280787a-fc53-47ac-9690-072e6a279303 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:11.957826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280787a-fc53-47ac-9690-072e6a279303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:11.959760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280787a-fc53-47ac-9690-072e6a279303 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:11.985652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1030/2051] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:11 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:11.989472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c90d0-176f-48ce-8b4d-2360a1caeeda None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:12.000499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c90d0-176f-48ce-8b4d-2360a1caeeda None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:12.063595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad08e73-63c3-4fcd-b5fb-ee35111fc3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:12.064219 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad08e73-63c3-4fcd-b5fb-ee35111fc3bb admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.064498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad08e73-63c3-4fcd-b5fb-ee35111fc3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.064768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad08e73-63c3-4fcd-b5fb-ee35111fc3bb admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.065482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad08e73-63c3-4fcd-b5fb-ee35111fc3bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:12.067389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad08e73-63c3-4fcd-b5fb-ee35111fc3bb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:12.088630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1022/2052] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:11 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:50:12.092465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280787a-fc53-47ac-9690-072e6a279303 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:12.102811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280787a-fc53-47ac-9690-072e6a279303 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:12.108530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d9ae-d8e9-477f-a150-db99b40b75ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:12.109202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d9ae-d8e9-477f-a150-db99b40b75ee admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.109485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d9ae-d8e9-477f-a150-db99b40b75ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.109764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d9ae-d8e9-477f-a150-db99b40b75ee admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.110537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435d9ae-d8e9-477f-a150-db99b40b75ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:12.112167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435d9ae-d8e9-477f-a150-db99b40b75ee admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:12.125852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1031/2053] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:12.126990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad08e73-63c3-4fcd-b5fb-ee35111fc3bb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:12.139129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad08e73-63c3-4fcd-b5fb-ee35111fc3bb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:12.144495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab1cd-df9f-40b1-a116-5b2f1d82b76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:12.145382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab1cd-df9f-40b1-a116-5b2f1d82b76d admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.145666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab1cd-df9f-40b1-a116-5b2f1d82b76d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.145941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab1cd-df9f-40b1-a116-5b2f1d82b76d admin admin] PATH_INFO: `/v3/projects/3bd016028302479485e26c39780e727d/users/9df02bb49fbe43079866d4c4579f205b/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.162756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab1cd-df9f-40b1-a116-5b2f1d82b76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd016028302479485e26c39780e727d, user_id=9df02bb49fbe43079866d4c4579f205b, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:12.166039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab1cd-df9f-40b1-a116-5b2f1d82b76d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:12.180685 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1023/2054] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:12 2022] PUT /identity/v3/projects/3bd016028302479485e26c39780e727d/users/9df02bb49fbe43079866d4c4579f205b/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:12.184918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d9ae-d8e9-477f-a150-db99b40b75ee admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:12.196304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d9ae-d8e9-477f-a150-db99b40b75ee admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:12.256781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ae353-4677-43d1-92dc-2ab558efcb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:12.260635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae353-4677-43d1-92dc-2ab558efcb09 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.260635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae353-4677-43d1-92dc-2ab558efcb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.260635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ae353-4677-43d1-92dc-2ab558efcb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.260635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ae353-4677-43d1-92dc-2ab558efcb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:12.261092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ae353-4677-43d1-92dc-2ab558efcb09 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:12.271219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1032/2055] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:50:12.275857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab1cd-df9f-40b1-a116-5b2f1d82b76d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:12.286166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab1cd-df9f-40b1-a116-5b2f1d82b76d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:12.291351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426850cb-7f03-4c32-9d01-dd05f7b3e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:12.292363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426850cb-7f03-4c32-9d01-dd05f7b3e62f admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.293331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426850cb-7f03-4c32-9d01-dd05f7b3e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.293331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426850cb-7f03-4c32-9d01-dd05f7b3e62f admin admin] PATH_INFO: `/v3/projects/3bd016028302479485e26c39780e727d/users/9df02bb49fbe43079866d4c4579f205b/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.296546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426850cb-7f03-4c32-9d01-dd05f7b3e62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bd016028302479485e26c39780e727d, user_id=9df02bb49fbe43079866d4c4579f205b, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:12.299226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426850cb-7f03-4c32-9d01-dd05f7b3e62f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:12.310554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1024/2056] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:12 2022] PUT /identity/v3/projects/3bd016028302479485e26c39780e727d/users/9df02bb49fbe43079866d4c4579f205b/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:12.322942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb28da-1f8a-48c6-8625-677bae10b432 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.323170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb28da-1f8a-48c6-8625-677bae10b432 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.323460 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb28da-1f8a-48c6-8625-677bae10b432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.350811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-6feb28da-1f8a-48c6-8625-677bae10b432 None None] MFA Rules not processed for user `9df02bb49fbe43079866d4c4579f205b`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:12.352622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6feb28da-1f8a-48c6-8625-677bae10b432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:12.421336 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1033/2057] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:12.431501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426850cb-7f03-4c32-9d01-dd05f7b3e62f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:12.433267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-426850cb-7f03-4c32-9d01-dd05f7b3e62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:12.489570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426850cb-7f03-4c32-9d01-dd05f7b3e62f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:12.493995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362042c4-7db2-4e70-bca6-55b8a75e3dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:12.494653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362042c4-7db2-4e70-bca6-55b8a75e3dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.494942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362042c4-7db2-4e70-bca6-55b8a75e3dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.495226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362042c4-7db2-4e70-bca6-55b8a75e3dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.504576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362042c4-7db2-4e70-bca6-55b8a75e3dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:12.506052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362042c4-7db2-4e70-bca6-55b8a75e3dc1 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:12.515279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1025/2058] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:50:12.650999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb28da-1f8a-48c6-8625-677bae10b432 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:12.728551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb28da-1f8a-48c6-8625-677bae10b432 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:12.734298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:12.735180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.735464 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.735774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] PATH_INFO: `/v3/users/852f71cfb41d4d71b88b010e0f3c28c0` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.736997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=852f71cfb41d4d71b88b010e0f3c28c0)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:12.738926 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:12.785385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852f71cfb41d4d71b88b010e0f3c28c0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:12.792322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852f71cfb41d4d71b88b010e0f3c28c0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:12.803499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852f71cfb41d4d71b88b010e0f3c28c0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:12.812386 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852f71cfb41d4d71b88b010e0f3c28c0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:12.813312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852f71cfb41d4d71b88b010e0f3c28c0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:12.819696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1034/2059] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:12 2022] DELETE /identity/v3/users/852f71cfb41d4d71b88b010e0f3c28c0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:12.824936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43a158-311f-4630-aa5b-d0c077405b34 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.825176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43a158-311f-4630-aa5b-d0c077405b34 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.825461 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43a158-311f-4630-aa5b-d0c077405b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.843712 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-3d43a158-311f-4630-aa5b-d0c077405b34 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:12.844897 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3d43a158-311f-4630-aa5b-d0c077405b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:12.903452 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1026/2060] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:12.913357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:12.915556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:12.971540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ea796-cf9c-44ba-8aa9-eaec82829c7c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:12.975231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea986-4317-486f-97b1-910e9604d94f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:12.975903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea986-4317-486f-97b1-910e9604d94f service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:12.976188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea986-4317-486f-97b1-910e9604d94f service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:12.976487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eea986-4317-486f-97b1-910e9604d94f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:12.986646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eea986-4317-486f-97b1-910e9604d94f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:12.988104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eea986-4317-486f-97b1-910e9604d94f service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:12.998485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1035/2061] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:50:13.286679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43a158-311f-4630-aa5b-d0c077405b34 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:13.291036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3d43a158-311f-4630-aa5b-d0c077405b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:13.314871 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43a158-311f-4630-aa5b-d0c077405b34 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:13.320565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:13.323918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:13.324300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:13.324497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] PATH_INFO: `/v3/projects/0b4ddd6f19ed441db1c93f466d10fb92` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:13.326559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4ddd6f19ed441db1c93f466d10fb92)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:13.329407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:13.384195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4ddd6f19ed441db1c93f466d10fb92', 'request_id': 'req-da754776-1c8b-4a34-ad53-a870f173dee1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.392276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4ddd6f19ed441db1c93f466d10fb92', 'request_id': 'req-da754776-1c8b-4a34-ad53-a870f173dee1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.399647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4ddd6f19ed441db1c93f466d10fb92', 'request_id': 'req-da754776-1c8b-4a34-ad53-a870f173dee1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.411794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] The token cache is being invalidate because project 0b4ddd6f19ed441db1c93f466d10fb92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:13.412178 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.412837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.415344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1027/2062] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:13 2022] DELETE /identity/v3/projects/0b4ddd6f19ed441db1c93f466d10fb92 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:13.419255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea986-4317-486f-97b1-910e9604d94f service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:13.429479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eea986-4317-486f-97b1-910e9604d94f service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:13.488264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:13.489141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:13.489427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:13.489705 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] PATH_INFO: `/v3/users/9df02bb49fbe43079866d4c4579f205b` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:13.490944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df02bb49fbe43079866d4c4579f205b)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:13.493564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:13.541436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df02bb49fbe43079866d4c4579f205b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.548776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df02bb49fbe43079866d4c4579f205b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.560984 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df02bb49fbe43079866d4c4579f205b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.569122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df02bb49fbe43079866d4c4579f205b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.569763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-bf754720-32c2-4af1-9310-3a2e3d9d26ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df02bb49fbe43079866d4c4579f205b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:13.576613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1036/2063] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:13 2022] DELETE /identity/v3/users/9df02bb49fbe43079866d4c4579f205b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:13.912932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:13.916002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:13.936837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754776-1c8b-4a34-ad53-a870f173dee1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:13.998063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:13.998962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:13.999247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:13.999526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] PATH_INFO: `/v3/projects/3bd016028302479485e26c39780e727d` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.000761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bd016028302479485e26c39780e727d)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.002706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.051368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bd016028302479485e26c39780e727d', 'request_id': 'req-87235aed-23c9-4fbb-aa64-888aee778e0f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:14.060099 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bd016028302479485e26c39780e727d', 'request_id': 'req-87235aed-23c9-4fbb-aa64-888aee778e0f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:14.066353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bd016028302479485e26c39780e727d', 'request_id': 'req-87235aed-23c9-4fbb-aa64-888aee778e0f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:14.078559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] The token cache is being invalidate because project 3bd016028302479485e26c39780e727d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:14.078846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:14.079508 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-87235aed-23c9-4fbb-aa64-888aee778e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:14.081532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1028/2064] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:13 2022] DELETE /identity/v3/projects/3bd016028302479485e26c39780e727d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:14.086986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f489a-0ae6-4a90-890e-49cc61fce18b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.087282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f489a-0ae6-4a90-890e-49cc61fce18b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.087577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f489a-0ae6-4a90-890e-49cc61fce18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.106043 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-267f489a-0ae6-4a90-890e-49cc61fce18b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:14.107297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-267f489a-0ae6-4a90-890e-49cc61fce18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:14.174544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1037/2065] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:14.183460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1ea78-54f0-4ab0-9b2e-bdd5d2588d51 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.184004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1ea78-54f0-4ab0-9b2e-bdd5d2588d51 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.184738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1ea78-54f0-4ab0-9b2e-bdd5d2588d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.212132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a4b1ea78-54f0-4ab0-9b2e-bdd5d2588d51 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:14.213482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a4b1ea78-54f0-4ab0-9b2e-bdd5d2588d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:14.221902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1029/2066] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:14.226130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f489a-0ae6-4a90-890e-49cc61fce18b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.235556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f489a-0ae6-4a90-890e-49cc61fce18b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.240267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3940d-b3af-40c7-853a-bdff5df9ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.240994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3940d-b3af-40c7-853a-bdff5df9ac9c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.241348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3940d-b3af-40c7-853a-bdff5df9ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.241861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3940d-b3af-40c7-853a-bdff5df9ac9c admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.243445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3940d-b3af-40c7-853a-bdff5df9ac9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:14.243858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3940d-b3af-40c7-853a-bdff5df9ac9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.245560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3940d-b3af-40c7-853a-bdff5df9ac9c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.258332 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1038/2067] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:50:14.262477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1ea78-54f0-4ab0-9b2e-bdd5d2588d51 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.271813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1ea78-54f0-4ab0-9b2e-bdd5d2588d51 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.277060 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744acf-b8b2-47ec-aa88-7dc801fa0c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.278622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744acf-b8b2-47ec-aa88-7dc801fa0c90 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.278913 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744acf-b8b2-47ec-aa88-7dc801fa0c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.279554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a744acf-b8b2-47ec-aa88-7dc801fa0c90 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.280306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744acf-b8b2-47ec-aa88-7dc801fa0c90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.282218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a744acf-b8b2-47ec-aa88-7dc801fa0c90 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.308944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1030/2068] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:14 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:14.313062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3940d-b3af-40c7-853a-bdff5df9ac9c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.323686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3940d-b3af-40c7-853a-bdff5df9ac9c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.379540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe53ee-608a-4fe4-a5b3-9a6c9ee0aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.380289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe53ee-608a-4fe4-a5b3-9a6c9ee0aaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.380588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe53ee-608a-4fe4-a5b3-9a6c9ee0aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.380861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe53ee-608a-4fe4-a5b3-9a6c9ee0aaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.382618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe53ee-608a-4fe4-a5b3-9a6c9ee0aaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.388895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe53ee-608a-4fe4-a5b3-9a6c9ee0aaa9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.411037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1039/2069] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:14 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:50:14.415330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744acf-b8b2-47ec-aa88-7dc801fa0c90 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.425678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a744acf-b8b2-47ec-aa88-7dc801fa0c90 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.430982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81763beb-20a8-40b3-9bfc-ea5691b47292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.431683 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81763beb-20a8-40b3-9bfc-ea5691b47292 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.431971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81763beb-20a8-40b3-9bfc-ea5691b47292 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.432255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81763beb-20a8-40b3-9bfc-ea5691b47292 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.432999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81763beb-20a8-40b3-9bfc-ea5691b47292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.434578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81763beb-20a8-40b3-9bfc-ea5691b47292 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.445934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1031/2070] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:14.450095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe53ee-608a-4fe4-a5b3-9a6c9ee0aaa9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.460541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe53ee-608a-4fe4-a5b3-9a6c9ee0aaa9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.465500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d12ef-3533-4883-a504-85999fe55efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.466194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d12ef-3533-4883-a504-85999fe55efc admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.466476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d12ef-3533-4883-a504-85999fe55efc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.466777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d12ef-3533-4883-a504-85999fe55efc admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.467538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d12ef-3533-4883-a504-85999fe55efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.469238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d12ef-3533-4883-a504-85999fe55efc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.479620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1040/2071] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:14.483753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81763beb-20a8-40b3-9bfc-ea5691b47292 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.494654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81763beb-20a8-40b3-9bfc-ea5691b47292 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.499217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2d2df-f424-465a-a4b1-156c97f63d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.500131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2d2df-f424-465a-a4b1-156c97f63d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.500418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2d2df-f424-465a-a4b1-156c97f63d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.500690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2d2df-f424-465a-a4b1-156c97f63d75 admin admin] PATH_INFO: `/v3/projects/2148e0b1c8d844e5b73b77f01d53dce0/users/f17c49517b6c4baa9cf0c0d41e35ea11/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.515916 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2d2df-f424-465a-a4b1-156c97f63d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2148e0b1c8d844e5b73b77f01d53dce0, user_id=f17c49517b6c4baa9cf0c0d41e35ea11, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.518547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2d2df-f424-465a-a4b1-156c97f63d75 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.533329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1032/2072] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:14 2022] PUT /identity/v3/projects/2148e0b1c8d844e5b73b77f01d53dce0/users/f17c49517b6c4baa9cf0c0d41e35ea11/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:14.544600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad73842-4514-4921-b23a-94a557edb848 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.545750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad73842-4514-4921-b23a-94a557edb848 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.546041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad73842-4514-4921-b23a-94a557edb848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.574620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-9ad73842-4514-4921-b23a-94a557edb848 None None] MFA Rules not processed for user `f17c49517b6c4baa9cf0c0d41e35ea11`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:14.575905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9ad73842-4514-4921-b23a-94a557edb848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:14.640348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1041/2073] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:14.646181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2d2df-f424-465a-a4b1-156c97f63d75 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.708279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2d2df-f424-465a-a4b1-156c97f63d75 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.713604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84140c95-a933-4bca-b729-8ed78562a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.714262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84140c95-a933-4bca-b729-8ed78562a540 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.714550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84140c95-a933-4bca-b729-8ed78562a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.714835 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84140c95-a933-4bca-b729-8ed78562a540 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.715546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84140c95-a933-4bca-b729-8ed78562a540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.717476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84140c95-a933-4bca-b729-8ed78562a540 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.742596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1033/2074] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:14 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:14.746740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad73842-4514-4921-b23a-94a557edb848 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.757183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad73842-4514-4921-b23a-94a557edb848 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.812416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489b227-fc6f-4b63-bec5-d26f18e2751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.813108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489b227-fc6f-4b63-bec5-d26f18e2751b admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.813400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489b227-fc6f-4b63-bec5-d26f18e2751b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.813681 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489b227-fc6f-4b63-bec5-d26f18e2751b admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.814400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489b227-fc6f-4b63-bec5-d26f18e2751b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.816382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489b227-fc6f-4b63-bec5-d26f18e2751b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.837135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1042/2075] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:14 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:14.841068 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84140c95-a933-4bca-b729-8ed78562a540 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.851254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84140c95-a933-4bca-b729-8ed78562a540 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.855829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132c53-9482-4bd6-8aee-334da061f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.856488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132c53-9482-4bd6-8aee-334da061f19d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.856775 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132c53-9482-4bd6-8aee-334da061f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.857050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba132c53-9482-4bd6-8aee-334da061f19d admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.857779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba132c53-9482-4bd6-8aee-334da061f19d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.859397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba132c53-9482-4bd6-8aee-334da061f19d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.870402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1034/2076] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:14.874156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489b227-fc6f-4b63-bec5-d26f18e2751b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.884864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489b227-fc6f-4b63-bec5-d26f18e2751b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.889537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e685e6f-191b-4868-ab53-875b7ad66d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.890201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e685e6f-191b-4868-ab53-875b7ad66d5b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.890496 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e685e6f-191b-4868-ab53-875b7ad66d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.890777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e685e6f-191b-4868-ab53-875b7ad66d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.891516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e685e6f-191b-4868-ab53-875b7ad66d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.893140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e685e6f-191b-4868-ab53-875b7ad66d5b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.905605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1043/2077] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:14.909946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132c53-9482-4bd6-8aee-334da061f19d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:14.919697 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba132c53-9482-4bd6-8aee-334da061f19d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:14.924413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056877f-41a5-4228-85bf-b24050009c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:14.925309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056877f-41a5-4228-85bf-b24050009c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.925592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056877f-41a5-4228-85bf-b24050009c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.925870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056877f-41a5-4228-85bf-b24050009c2d admin admin] PATH_INFO: `/v3/projects/f246e5f69a834b7a8d635ae68c80e93b/users/96b50f014a804d3fb993f99d9e07f0d5/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:14.942081 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056877f-41a5-4228-85bf-b24050009c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f246e5f69a834b7a8d635ae68c80e93b, user_id=96b50f014a804d3fb993f99d9e07f0d5, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:14.944695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056877f-41a5-4228-85bf-b24050009c2d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:14.959815 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1035/2078] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:14 2022] PUT /identity/v3/projects/f246e5f69a834b7a8d635ae68c80e93b/users/96b50f014a804d3fb993f99d9e07f0d5/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:14.972670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd3c76-7a09-49eb-93fe-a5ef3f776ad4 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:14.972959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd3c76-7a09-49eb-93fe-a5ef3f776ad4 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:14.973239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd3c76-7a09-49eb-93fe-a5ef3f776ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.000593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-cdcd3c76-7a09-49eb-93fe-a5ef3f776ad4 None None] MFA Rules not processed for user `96b50f014a804d3fb993f99d9e07f0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:15.001865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-cdcd3c76-7a09-49eb-93fe-a5ef3f776ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:15.067703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1044/2079] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:15.073115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056877f-41a5-4228-85bf-b24050009c2d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:15.145904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056877f-41a5-4228-85bf-b24050009c2d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:15.151775 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951da82-a04f-4b04-b2fe-f85a6f524eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:15.152396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951da82-a04f-4b04-b2fe-f85a6f524eef admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:15.152675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951da82-a04f-4b04-b2fe-f85a6f524eef admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:15.152954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9951da82-a04f-4b04-b2fe-f85a6f524eef admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.153692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951da82-a04f-4b04-b2fe-f85a6f524eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:15.155599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9951da82-a04f-4b04-b2fe-f85a6f524eef admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:15.186439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1036/2080] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:15 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:50:15.187916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd3c76-7a09-49eb-93fe-a5ef3f776ad4 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:15.198890 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd3c76-7a09-49eb-93fe-a5ef3f776ad4 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:15.256492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2519300-5d06-4a1f-b091-1223edf590f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:15.257693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2519300-5d06-4a1f-b091-1223edf590f8 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:15.257974 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2519300-5d06-4a1f-b091-1223edf590f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:15.258254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2519300-5d06-4a1f-b091-1223edf590f8 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.259141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2519300-5d06-4a1f-b091-1223edf590f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:15.260976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2519300-5d06-4a1f-b091-1223edf590f8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:15.288475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1045/2081] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:15 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:50:15.291944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951da82-a04f-4b04-b2fe-f85a6f524eef admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:15.315800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9951da82-a04f-4b04-b2fe-f85a6f524eef admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:15.323559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431346-9afd-47dd-ac8d-06ebf9c43d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:15.324448 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431346-9afd-47dd-ac8d-06ebf9c43d54 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:15.324853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431346-9afd-47dd-ac8d-06ebf9c43d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:15.325202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58431346-9afd-47dd-ac8d-06ebf9c43d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.326733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58431346-9afd-47dd-ac8d-06ebf9c43d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:15.330595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58431346-9afd-47dd-ac8d-06ebf9c43d54 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:15.349300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1037/2082] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:15.350442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2519300-5d06-4a1f-b091-1223edf590f8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:15.361775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2519300-5d06-4a1f-b091-1223edf590f8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:15.366934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5765d8-2964-402a-ab19-59d594f0b1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:15.367980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5765d8-2964-402a-ab19-59d594f0b1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:15.368384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5765d8-2964-402a-ab19-59d594f0b1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:15.368756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5765d8-2964-402a-ab19-59d594f0b1e4 admin admin] PATH_INFO: `/v3/projects/5dff32fa99bb4828812592af39577bb3/users/eb4cd39e0848429da10a95ebe9491a96/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.386226 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5765d8-2964-402a-ab19-59d594f0b1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dff32fa99bb4828812592af39577bb3, user_id=eb4cd39e0848429da10a95ebe9491a96, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:15.389024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5765d8-2964-402a-ab19-59d594f0b1e4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:15.412570 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1046/2083] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:15 2022] PUT /identity/v3/projects/5dff32fa99bb4828812592af39577bb3/users/eb4cd39e0848429da10a95ebe9491a96/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:15.416690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431346-9afd-47dd-ac8d-06ebf9c43d54 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:15.426967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58431346-9afd-47dd-ac8d-06ebf9c43d54 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:15.499056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec732ad-4c97-47e6-bc05-e4fddfba4a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:15.499777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec732ad-4c97-47e6-bc05-e4fddfba4a40 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:15.500065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec732ad-4c97-47e6-bc05-e4fddfba4a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:15.500347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec732ad-4c97-47e6-bc05-e4fddfba4a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.501106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec732ad-4c97-47e6-bc05-e4fddfba4a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:15.502709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec732ad-4c97-47e6-bc05-e4fddfba4a40 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:15.519780 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1038/2084] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:15.520334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5765d8-2964-402a-ab19-59d594f0b1e4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:15.537099 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5765d8-2964-402a-ab19-59d594f0b1e4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:15.554299 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae6fe6-1f35-4e93-a52a-e6ee50f58743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:15.555358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae6fe6-1f35-4e93-a52a-e6ee50f58743 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:15.555763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae6fe6-1f35-4e93-a52a-e6ee50f58743 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:15.556049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae6fe6-1f35-4e93-a52a-e6ee50f58743 admin admin] PATH_INFO: `/v3/projects/5dff32fa99bb4828812592af39577bb3/users/eb4cd39e0848429da10a95ebe9491a96/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.558149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae6fe6-1f35-4e93-a52a-e6ee50f58743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dff32fa99bb4828812592af39577bb3, user_id=eb4cd39e0848429da10a95ebe9491a96, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:15.560866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae6fe6-1f35-4e93-a52a-e6ee50f58743 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:15.572912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1047/2085] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:15 2022] PUT /identity/v3/projects/5dff32fa99bb4828812592af39577bb3/users/eb4cd39e0848429da10a95ebe9491a96/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:15.583097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f38da-9a53-48d5-9919-71ef0b45a0f7 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:15.583400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f38da-9a53-48d5-9919-71ef0b45a0f7 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:15.584076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f38da-9a53-48d5-9919-71ef0b45a0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.619688 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-803f38da-9a53-48d5-9919-71ef0b45a0f7 None None] MFA Rules not processed for user `eb4cd39e0848429da10a95ebe9491a96`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:15.621285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-803f38da-9a53-48d5-9919-71ef0b45a0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:15.710044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1039/2086] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:15.722776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae6fe6-1f35-4e93-a52a-e6ee50f58743 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:15.726909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-02ae6fe6-1f35-4e93-a52a-e6ee50f58743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:15.791262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae6fe6-1f35-4e93-a52a-e6ee50f58743 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:15.795317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440e2fd-2fd0-471e-aa1f-d97ddd6bda05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:15.795848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440e2fd-2fd0-471e-aa1f-d97ddd6bda05 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:15.796095 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440e2fd-2fd0-471e-aa1f-d97ddd6bda05 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:15.796373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440e2fd-2fd0-471e-aa1f-d97ddd6bda05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.806111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440e2fd-2fd0-471e-aa1f-d97ddd6bda05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:15.807547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440e2fd-2fd0-471e-aa1f-d97ddd6bda05 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:15.816963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1048/2087] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:15.858657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f38da-9a53-48d5-9919-71ef0b45a0f7 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:15.860121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-803f38da-9a53-48d5-9919-71ef0b45a0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:15.872129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f38da-9a53-48d5-9919-71ef0b45a0f7 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:15.875731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e198ac-e7d1-4f75-a03e-053772541fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:15.876371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e198ac-e7d1-4f75-a03e-053772541fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:15.876657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e198ac-e7d1-4f75-a03e-053772541fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:15.876935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e198ac-e7d1-4f75-a03e-053772541fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:15.932038 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e198ac-e7d1-4f75-a03e-053772541fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:15.933489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e198ac-e7d1-4f75-a03e-053772541fa0 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:15.943168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1040/2088] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:21.931125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440e2fd-2fd0-471e-aa1f-d97ddd6bda05 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:21.995187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440e2fd-2fd0-471e-aa1f-d97ddd6bda05 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:21.999774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:22.000759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:22.001039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:22.001311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] PATH_INFO: `/v3/users/f17c49517b6c4baa9cf0c0d41e35ea11` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:22.002529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f17c49517b6c4baa9cf0c0d41e35ea11)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:22.004475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:22.052356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f17c49517b6c4baa9cf0c0d41e35ea11'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.059433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f17c49517b6c4baa9cf0c0d41e35ea11'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.072608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f17c49517b6c4baa9cf0c0d41e35ea11'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.080022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f17c49517b6c4baa9cf0c0d41e35ea11'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.080735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f17c49517b6c4baa9cf0c0d41e35ea11'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.087271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1049/2089] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:21 2022] DELETE /identity/v3/users/f17c49517b6c4baa9cf0c0d41e35ea11 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:22.092116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37e3a4-f738-4b0b-97aa-20701b1ef83e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:22.092625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37e3a4-f738-4b0b-97aa-20701b1ef83e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:22.092718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37e3a4-f738-4b0b-97aa-20701b1ef83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:22.111736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ea37e3a4-f738-4b0b-97aa-20701b1ef83e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:22.112596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ea37e3a4-f738-4b0b-97aa-20701b1ef83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:22.184749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1041/2090] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:22.193063 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:22.194692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:22.283172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e11e9d-daf8-41cc-a768-f774685e18e3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:22.287479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d3ecb-c60e-4013-91bf-89e479524fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:22.288361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d3ecb-c60e-4013-91bf-89e479524fbb service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:22.288456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d3ecb-c60e-4013-91bf-89e479524fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:22.289314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d3ecb-c60e-4013-91bf-89e479524fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:22.300613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d3ecb-c60e-4013-91bf-89e479524fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:22.302047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d3ecb-c60e-4013-91bf-89e479524fbb service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:22.315911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1050/2091] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:50:22.602009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37e3a4-f738-4b0b-97aa-20701b1ef83e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:22.603594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ea37e3a4-f738-4b0b-97aa-20701b1ef83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:22.617522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37e3a4-f738-4b0b-97aa-20701b1ef83e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:22.622488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:22.623499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:22.623810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:22.624089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] PATH_INFO: `/v3/projects/2148e0b1c8d844e5b73b77f01d53dce0` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:22.625773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] RBAC: Authorizing `identity:delete_project(project_id=2148e0b1c8d844e5b73b77f01d53dce0)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:22.627936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:22.681160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2148e0b1c8d844e5b73b77f01d53dce0', 'request_id': 'req-f91635f1-822a-4ee0-9b21-685f70d018de'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.688268 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2148e0b1c8d844e5b73b77f01d53dce0', 'request_id': 'req-f91635f1-822a-4ee0-9b21-685f70d018de'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.694581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2148e0b1c8d844e5b73b77f01d53dce0', 'request_id': 'req-f91635f1-822a-4ee0-9b21-685f70d018de'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.706018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] The token cache is being invalidate because project 2148e0b1c8d844e5b73b77f01d53dce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:22.706311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.707006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.708745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1042/2092] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:22 2022] DELETE /identity/v3/projects/2148e0b1c8d844e5b73b77f01d53dce0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:22.715858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d3ecb-c60e-4013-91bf-89e479524fbb service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:22.723169 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d3ecb-c60e-4013-91bf-89e479524fbb service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:22.781178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:22.782053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:22.782339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:22.782678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] PATH_INFO: `/v3/users/96b50f014a804d3fb993f99d9e07f0d5` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:22.783957 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b50f014a804d3fb993f99d9e07f0d5)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:22.785919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:22.831629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b50f014a804d3fb993f99d9e07f0d5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.838348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b50f014a804d3fb993f99d9e07f0d5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.849460 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b50f014a804d3fb993f99d9e07f0d5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.857321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b50f014a804d3fb993f99d9e07f0d5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.858024 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b50f014a804d3fb993f99d9e07f0d5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:22.864249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1051/2093] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:22 2022] DELETE /identity/v3/users/96b50f014a804d3fb993f99d9e07f0d5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:23.154456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:23.156697 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:23.174939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91635f1-822a-4ee0-9b21-685f70d018de admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:23.233159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:23.234032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:23.234323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:23.234596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] PATH_INFO: `/v3/projects/f246e5f69a834b7a8d635ae68c80e93b` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:23.235905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f246e5f69a834b7a8d635ae68c80e93b)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:23.237819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:23.285509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f246e5f69a834b7a8d635ae68c80e93b', 'request_id': 'req-e522a4bb-948a-47c7-b856-edbf858bf52a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.294566 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f246e5f69a834b7a8d635ae68c80e93b', 'request_id': 'req-e522a4bb-948a-47c7-b856-edbf858bf52a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.300972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f246e5f69a834b7a8d635ae68c80e93b', 'request_id': 'req-e522a4bb-948a-47c7-b856-edbf858bf52a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.311748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] The token cache is being invalidate because project f246e5f69a834b7a8d635ae68c80e93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:23.312047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.312736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.314259 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1043/2094] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:23 2022] DELETE /identity/v3/projects/f246e5f69a834b7a8d635ae68c80e93b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:23.318247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:23.320882 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:23.336006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303dbe9-6631-45c2-b0fe-90997b5a82bd admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:23.396744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:23.397653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:23.398386 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:23.398669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] PATH_INFO: `/v3/users/eb4cd39e0848429da10a95ebe9491a96` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:23.399993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4cd39e0848429da10a95ebe9491a96)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:23.402000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:23.453836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4cd39e0848429da10a95ebe9491a96'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.461301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4cd39e0848429da10a95ebe9491a96'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.473331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4cd39e0848429da10a95ebe9491a96'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.480685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4cd39e0848429da10a95ebe9491a96'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.481370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32e55825-c17f-41d1-b0b6-312b190aa3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4cd39e0848429da10a95ebe9491a96'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.487230 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1052/2095] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:23 2022] DELETE /identity/v3/users/eb4cd39e0848429da10a95ebe9491a96 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:23.765236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:23.767104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:23.786091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522a4bb-948a-47c7-b856-edbf858bf52a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:23.845112 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:23.845940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:23.846223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:23.846501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] PATH_INFO: `/v3/projects/5dff32fa99bb4828812592af39577bb3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:23.847760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dff32fa99bb4828812592af39577bb3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:23.849775 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:23.896089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dff32fa99bb4828812592af39577bb3', 'request_id': 'req-d18901b6-5e59-4da4-bc28-359c21829912'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.905159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dff32fa99bb4828812592af39577bb3', 'request_id': 'req-d18901b6-5e59-4da4-bc28-359c21829912'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.912042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dff32fa99bb4828812592af39577bb3', 'request_id': 'req-d18901b6-5e59-4da4-bc28-359c21829912'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.922509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] The token cache is being invalidate because project 5dff32fa99bb4828812592af39577bb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:23.922800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.923434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d18901b6-5e59-4da4-bc28-359c21829912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:23.924984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1044/2096] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:23 2022] DELETE /identity/v3/projects/5dff32fa99bb4828812592af39577bb3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:23.931909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257aa24-223e-49a5-9535-2c8d7ade190c None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:23.932196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257aa24-223e-49a5-9535-2c8d7ade190c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:23.932493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257aa24-223e-49a5-9535-2c8d7ade190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:23.950513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3257aa24-223e-49a5-9535-2c8d7ade190c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:23.951748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3257aa24-223e-49a5-9535-2c8d7ade190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:24.008719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1053/2097] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:24.017043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a50d73-4798-4ead-95be-7f1a3e5ba69c None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:24.017363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a50d73-4798-4ead-95be-7f1a3e5ba69c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:24.017610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a50d73-4798-4ead-95be-7f1a3e5ba69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:24.036297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-62a50d73-4798-4ead-95be-7f1a3e5ba69c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:24.037457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-62a50d73-4798-4ead-95be-7f1a3e5ba69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:24.046076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1045/2098] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:50:24.050069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257aa24-223e-49a5-9535-2c8d7ade190c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:24.059604 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257aa24-223e-49a5-9535-2c8d7ade190c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:24.065266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee3667-4b15-471c-a6cd-f1a1a01e4f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:24.065266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee3667-4b15-471c-a6cd-f1a1a01e4f52 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:24.065266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee3667-4b15-471c-a6cd-f1a1a01e4f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:24.065610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee3667-4b15-471c-a6cd-f1a1a01e4f52 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:24.066265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee3667-4b15-471c-a6cd-f1a1a01e4f52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:24.066586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee3667-4b15-471c-a6cd-f1a1a01e4f52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:24.068202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee3667-4b15-471c-a6cd-f1a1a01e4f52 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:24.080036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1054/2099] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:50:24.084524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a50d73-4798-4ead-95be-7f1a3e5ba69c None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:24.094844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a50d73-4798-4ead-95be-7f1a3e5ba69c None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:24.099646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790b60e-6e37-43f6-83eb-68093061825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:24.100247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b60e-6e37-43f6-83eb-68093061825f admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:24.100631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b60e-6e37-43f6-83eb-68093061825f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:24.100804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790b60e-6e37-43f6-83eb-68093061825f admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:24.102108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790b60e-6e37-43f6-83eb-68093061825f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:24.104047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790b60e-6e37-43f6-83eb-68093061825f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:24.133767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1046/2100] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:24 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:24.135022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee3667-4b15-471c-a6cd-f1a1a01e4f52 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:24.144938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee3667-4b15-471c-a6cd-f1a1a01e4f52 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:24.205477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef2b46-1219-4899-88ba-47a58f3279b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:24.206157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef2b46-1219-4899-88ba-47a58f3279b3 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:24.206452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef2b46-1219-4899-88ba-47a58f3279b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:24.206734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef2b46-1219-4899-88ba-47a58f3279b3 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:24.207477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef2b46-1219-4899-88ba-47a58f3279b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:24.209462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef2b46-1219-4899-88ba-47a58f3279b3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:24.231520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1055/2101] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:24 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:24.235769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790b60e-6e37-43f6-83eb-68093061825f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:24.246091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790b60e-6e37-43f6-83eb-68093061825f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:24.250615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3366d75-b20e-4bb2-acdd-36de673c6386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:24.251263 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3366d75-b20e-4bb2-acdd-36de673c6386 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:24.251544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3366d75-b20e-4bb2-acdd-36de673c6386 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:24.251847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3366d75-b20e-4bb2-acdd-36de673c6386 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:24.252579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3366d75-b20e-4bb2-acdd-36de673c6386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:24.254188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3366d75-b20e-4bb2-acdd-36de673c6386 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:24.264432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1047/2102] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:24.268619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef2b46-1219-4899-88ba-47a58f3279b3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:24.280380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef2b46-1219-4899-88ba-47a58f3279b3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:24.285145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ffc39a-d80d-41f4-bcdf-0f7dc247b995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:24.285811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc39a-d80d-41f4-bcdf-0f7dc247b995 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:24.286094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc39a-d80d-41f4-bcdf-0f7dc247b995 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:24.286373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ffc39a-d80d-41f4-bcdf-0f7dc247b995 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:24.287116 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffc39a-d80d-41f4-bcdf-0f7dc247b995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:24.289383 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ffc39a-d80d-41f4-bcdf-0f7dc247b995 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:24.299124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1056/2103] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:24.303285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3366d75-b20e-4bb2-acdd-36de673c6386 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:24.315441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3366d75-b20e-4bb2-acdd-36de673c6386 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:24.320688 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c927-5e00-4146-8d8a-6a2dd83558fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:24.321576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c927-5e00-4146-8d8a-6a2dd83558fb admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:24.322036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c927-5e00-4146-8d8a-6a2dd83558fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:24.322346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670c927-5e00-4146-8d8a-6a2dd83558fb admin admin] PATH_INFO: `/v3/projects/f30ceb09fa7c4c92bb12f87d3172d1e6/users/0a5e14edde1f4236a2ba8e8f433ec06d/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:24.337649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670c927-5e00-4146-8d8a-6a2dd83558fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30ceb09fa7c4c92bb12f87d3172d1e6, user_id=0a5e14edde1f4236a2ba8e8f433ec06d, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:24.340352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670c927-5e00-4146-8d8a-6a2dd83558fb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:24.354351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1048/2104] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:24 2022] PUT /identity/v3/projects/f30ceb09fa7c4c92bb12f87d3172d1e6/users/0a5e14edde1f4236a2ba8e8f433ec06d/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:24.365313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595875-8888-4905-b2c3-5beecef96843 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:24.365849 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595875-8888-4905-b2c3-5beecef96843 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:24.365930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83595875-8888-4905-b2c3-5beecef96843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:24.401590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-83595875-8888-4905-b2c3-5beecef96843 None None] MFA Rules not processed for user `0a5e14edde1f4236a2ba8e8f433ec06d`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:24.402918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-83595875-8888-4905-b2c3-5beecef96843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:24.468756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1057/2105] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:24.480049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c927-5e00-4146-8d8a-6a2dd83558fb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:24.481763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7670c927-5e00-4146-8d8a-6a2dd83558fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:24.543704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670c927-5e00-4146-8d8a-6a2dd83558fb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:24.547394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c615ce-eaa3-4dad-8388-0773503277b1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '295fe8f61f87423bb49471e2f0085690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:24.548243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c615ce-eaa3-4dad-8388-0773503277b1 service glance] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:24.548573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c615ce-eaa3-4dad-8388-0773503277b1 service glance] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:24.548842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c615ce-eaa3-4dad-8388-0773503277b1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:24.558149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c615ce-eaa3-4dad-8388-0773503277b1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:24.559824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c615ce-eaa3-4dad-8388-0773503277b1 service glance] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:24.569251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1049/2106] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:25.641542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83595875-8888-4905-b2c3-5beecef96843 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:25.642969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-83595875-8888-4905-b2c3-5beecef96843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:25.708241 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83595875-8888-4905-b2c3-5beecef96843 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:25.713624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:25.714497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:25.714782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:25.715105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] PATH_INFO: `/v3/users/f845b289b498448da4cbc106a26fd29a` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:25.716307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f845b289b498448da4cbc106a26fd29a)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:25.718219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:25.765256 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f845b289b498448da4cbc106a26fd29a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:25.771706 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f845b289b498448da4cbc106a26fd29a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:25.784006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f845b289b498448da4cbc106a26fd29a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:25.791918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f845b289b498448da4cbc106a26fd29a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:25.792611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f845b289b498448da4cbc106a26fd29a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:25.798486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1058/2107] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:25 2022] DELETE /identity/v3/users/f845b289b498448da4cbc106a26fd29a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:25.802898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81efc3-997a-4d50-9ce7-a6e772ff34b0 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:25.803363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81efc3-997a-4d50-9ce7-a6e772ff34b0 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:25.803473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81efc3-997a-4d50-9ce7-a6e772ff34b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:25.821073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-cd81efc3-997a-4d50-9ce7-a6e772ff34b0 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:25.822287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cd81efc3-997a-4d50-9ce7-a6e772ff34b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:25.878374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1050/2108] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:25.888579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:25.890002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:25.945537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f8822-f2bb-4769-8433-1244744c5065 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:25.949183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa747d17-fb17-47a9-b622-3da10f944cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:25.949820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747d17-fb17-47a9-b622-3da10f944cbe service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:25.950119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747d17-fb17-47a9-b622-3da10f944cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:25.950382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa747d17-fb17-47a9-b622-3da10f944cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:25.959060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa747d17-fb17-47a9-b622-3da10f944cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:25.961055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa747d17-fb17-47a9-b622-3da10f944cbe service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:25.970484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1059/2109] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:26.233576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81efc3-997a-4d50-9ce7-a6e772ff34b0 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:26.235015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cd81efc3-997a-4d50-9ce7-a6e772ff34b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:26.249392 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81efc3-997a-4d50-9ce7-a6e772ff34b0 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:26.254600 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:26.255954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.256243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.256583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] PATH_INFO: `/v3/projects/9bc4dafc57324684be2e14db0fb58823` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.258982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc4dafc57324684be2e14db0fb58823)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:26.261012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:26.306980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc4dafc57324684be2e14db0fb58823', 'request_id': 'req-0000765e-0ddb-4f02-ad60-c31457c6265a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:26.313820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc4dafc57324684be2e14db0fb58823', 'request_id': 'req-0000765e-0ddb-4f02-ad60-c31457c6265a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:26.320082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc4dafc57324684be2e14db0fb58823', 'request_id': 'req-0000765e-0ddb-4f02-ad60-c31457c6265a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:26.329984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] The token cache is being invalidate because project 9bc4dafc57324684be2e14db0fb58823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:26.330271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:26.330893 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-0000765e-0ddb-4f02-ad60-c31457c6265a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:26.332588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1051/2110] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:26 2022] DELETE /identity/v3/projects/9bc4dafc57324684be2e14db0fb58823 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:26.338889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf0a2-8e2b-4f1f-a51d-962f6f18b2d9 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.339254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf0a2-8e2b-4f1f-a51d-962f6f18b2d9 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.339630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf0a2-8e2b-4f1f-a51d-962f6f18b2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.358285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-17aaf0a2-8e2b-4f1f-a51d-962f6f18b2d9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:26.359489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-17aaf0a2-8e2b-4f1f-a51d-962f6f18b2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:26.419603 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1060/2111] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:50:26.427385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b68f-dea0-450c-a870-7213f64454aa None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.427701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b68f-dea0-450c-a870-7213f64454aa None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.428002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b68f-dea0-450c-a870-7213f64454aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.446461 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c810b68f-dea0-450c-a870-7213f64454aa None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:26.447706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c810b68f-dea0-450c-a870-7213f64454aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:26.455740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1052/2112] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:26.459921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf0a2-8e2b-4f1f-a51d-962f6f18b2d9 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:26.470666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf0a2-8e2b-4f1f-a51d-962f6f18b2d9 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:26.475751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a8412-84d1-4354-acb1-07f133c7e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:26.477033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a8412-84d1-4354-acb1-07f133c7e532 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.477318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a8412-84d1-4354-acb1-07f133c7e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.477601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a8412-84d1-4354-acb1-07f133c7e532 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.478357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a8412-84d1-4354-acb1-07f133c7e532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:26.478678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a8412-84d1-4354-acb1-07f133c7e532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:26.480318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a8412-84d1-4354-acb1-07f133c7e532 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:26.493398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1061/2113] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:50:26.497232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b68f-dea0-450c-a870-7213f64454aa None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:26.507499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b68f-dea0-450c-a870-7213f64454aa None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:26.514410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c55b43-dc2e-4162-bad7-d98925477070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:26.515259 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c55b43-dc2e-4162-bad7-d98925477070 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.515552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c55b43-dc2e-4162-bad7-d98925477070 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.515866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c55b43-dc2e-4162-bad7-d98925477070 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.516746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c55b43-dc2e-4162-bad7-d98925477070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:26.518836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c55b43-dc2e-4162-bad7-d98925477070 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:26.556867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1053/2114] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:26 2022] POST /identity/v3/projects => generated 389 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:26.560819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a8412-84d1-4354-acb1-07f133c7e532 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:26.573077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a8412-84d1-4354-acb1-07f133c7e532 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:26.635127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d39ae7-a515-4b4e-b865-5899d4f35dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:26.635830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d39ae7-a515-4b4e-b865-5899d4f35dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.636120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d39ae7-a515-4b4e-b865-5899d4f35dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.636396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d39ae7-a515-4b4e-b865-5899d4f35dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.637105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d39ae7-a515-4b4e-b865-5899d4f35dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:26.639017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d39ae7-a515-4b4e-b865-5899d4f35dc0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:26.659574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1062/2115] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:26 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:26.664138 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c55b43-dc2e-4162-bad7-d98925477070 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:26.674079 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c55b43-dc2e-4162-bad7-d98925477070 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:26.678717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b24f-2657-45f5-9c8d-02028f844da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:26.680059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b24f-2657-45f5-9c8d-02028f844da1 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.680343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b24f-2657-45f5-9c8d-02028f844da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.680620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b24f-2657-45f5-9c8d-02028f844da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.681357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b24f-2657-45f5-9c8d-02028f844da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:26.682949 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71b24f-2657-45f5-9c8d-02028f844da1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:26.693631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1054/2116] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:50:26.698326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d39ae7-a515-4b4e-b865-5899d4f35dc0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:26.708238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d39ae7-a515-4b4e-b865-5899d4f35dc0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:26.713384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a9c48-20fa-4ca2-870a-7167232e5746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:26.714034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a9c48-20fa-4ca2-870a-7167232e5746 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.714313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a9c48-20fa-4ca2-870a-7167232e5746 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.714588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a9c48-20fa-4ca2-870a-7167232e5746 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.715434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a9c48-20fa-4ca2-870a-7167232e5746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:26.717054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a9c48-20fa-4ca2-870a-7167232e5746 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:26.726650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1063/2117] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:26.730789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b24f-2657-45f5-9c8d-02028f844da1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:26.740811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71b24f-2657-45f5-9c8d-02028f844da1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:26.745906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ff552-f8e9-4c71-9d42-39c591af99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:26.746761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ff552-f8e9-4c71-9d42-39c591af99c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.747046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ff552-f8e9-4c71-9d42-39c591af99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.747325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ff552-f8e9-4c71-9d42-39c591af99c8 admin admin] PATH_INFO: `/v3/projects/656628e4e7ea4e348509fa2cf4175d8e/users/4791580f03024545b03d41b3f21b3974/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.762357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ff552-f8e9-4c71-9d42-39c591af99c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=656628e4e7ea4e348509fa2cf4175d8e, user_id=4791580f03024545b03d41b3f21b3974, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:26.765030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83ff552-f8e9-4c71-9d42-39c591af99c8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:26.778972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1055/2118] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:26 2022] PUT /identity/v3/projects/656628e4e7ea4e348509fa2cf4175d8e/users/4791580f03024545b03d41b3f21b3974/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:26.789414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac463e5-00df-43ba-afc9-69c1e776eefb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.789712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac463e5-00df-43ba-afc9-69c1e776eefb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.789989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac463e5-00df-43ba-afc9-69c1e776eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.815186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-0ac463e5-00df-43ba-afc9-69c1e776eefb None None] MFA Rules not processed for user `4791580f03024545b03d41b3f21b3974`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:26.816499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0ac463e5-00df-43ba-afc9-69c1e776eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:26.877858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1064/2119] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:26.887957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ff552-f8e9-4c71-9d42-39c591af99c8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:26.889674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f83ff552-f8e9-4c71-9d42-39c591af99c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:26.945682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ff552-f8e9-4c71-9d42-39c591af99c8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:26.949345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ae59-9d21-4bb8-8ea3-aabe9ae69283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:26.949990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ae59-9d21-4bb8-8ea3-aabe9ae69283 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:26.950272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ae59-9d21-4bb8-8ea3-aabe9ae69283 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:26.950550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2ae59-9d21-4bb8-8ea3-aabe9ae69283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:26.958923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2ae59-9d21-4bb8-8ea3-aabe9ae69283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:26.960891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2ae59-9d21-4bb8-8ea3-aabe9ae69283 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:26.969740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1056/2120] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:38.140829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a38228-8d3d-4ec4-a0be-9bee214b9ddb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:38.141374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a38228-8d3d-4ec4-a0be-9bee214b9ddb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:38.141374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a38228-8d3d-4ec4-a0be-9bee214b9ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:38.161946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-78a38228-8d3d-4ec4-a0be-9bee214b9ddb None None] MFA Rules not processed for user `3cfe4a71879849b581eb8b48b24107fd`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:38.163267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-78a38228-8d3d-4ec4-a0be-9bee214b9ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:38.218592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1065/2121] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:47.430194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ae59-9d21-4bb8-8ea3-aabe9ae69283 service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:47.526693 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a38228-8d3d-4ec4-a0be-9bee214b9ddb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:47.528650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-78a38228-8d3d-4ec4-a0be-9bee214b9ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:47.532411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2ae59-9d21-4bb8-8ea3-aabe9ae69283 service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:47.540553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:47.541753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:47.542223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:47.542973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] PATH_INFO: `/v3/users/4791580f03024545b03d41b3f21b3974` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:47.544457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4791580f03024545b03d41b3f21b3974)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:47.547351 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:47.563143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a38228-8d3d-4ec4-a0be-9bee214b9ddb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:47.570332 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:47.571749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:47.572369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:47.572875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] PATH_INFO: `/v3/users/e2affcea661f4a3b9f0b5306f01a9e6d` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:47.574988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2affcea661f4a3b9f0b5306f01a9e6d)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:47.577634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:47.625136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4791580f03024545b03d41b3f21b3974'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.635456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4791580f03024545b03d41b3f21b3974'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.636695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4791580f03024545b03d41b3f21b3974'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.642462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2affcea661f4a3b9f0b5306f01a9e6d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.652404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4791580f03024545b03d41b3f21b3974'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.652831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2affcea661f4a3b9f0b5306f01a9e6d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.665337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5b3be1b-e497-4290-a93d-77a522832e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4791580f03024545b03d41b3f21b3974'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.673594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1057/2122] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:47 2022] DELETE /identity/v3/users/4791580f03024545b03d41b3f21b3974 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:47.678566 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37f550-e0ad-452a-b5d1-bf76e7742389 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:47.679773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37f550-e0ad-452a-b5d1-bf76e7742389 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:47.680139 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37f550-e0ad-452a-b5d1-bf76e7742389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:47.684081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2affcea661f4a3b9f0b5306f01a9e6d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.702367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6b37f550-e0ad-452a-b5d1-bf76e7742389 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:47.703096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2affcea661f4a3b9f0b5306f01a9e6d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.703800 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c497f438-3a39-42d7-a501-ff79742c034e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2affcea661f4a3b9f0b5306f01a9e6d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:47.703958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6b37f550-e0ad-452a-b5d1-bf76e7742389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:47.711491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1066/2123] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:47 2022] DELETE /identity/v3/users/e2affcea661f4a3b9f0b5306f01a9e6d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:47.716093 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec234-aa3c-41de-a3e1-eea7f6d60376 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:47.716564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec234-aa3c-41de-a3e1-eea7f6d60376 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:47.717173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcec234-aa3c-41de-a3e1-eea7f6d60376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:47.735744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ddcec234-aa3c-41de-a3e1-eea7f6d60376 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:47.736980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ddcec234-aa3c-41de-a3e1-eea7f6d60376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:47.764167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1058/2124] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:47.774442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37f550-e0ad-452a-b5d1-bf76e7742389 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:47.775914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6b37f550-e0ad-452a-b5d1-bf76e7742389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:47.799001 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1067/2125] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:50:47.809535 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcec234-aa3c-41de-a3e1-eea7f6d60376 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:47.811107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ddcec234-aa3c-41de-a3e1-eea7f6d60376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:47.833316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37f550-e0ad-452a-b5d1-bf76e7742389 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:47.873771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcec234-aa3c-41de-a3e1-eea7f6d60376 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:47.877593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7ebb-04b6-461b-ae34-5d4e43c17b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:47.878358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7ebb-04b6-461b-ae34-5d4e43c17b63 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:47.878748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7ebb-04b6-461b-ae34-5d4e43c17b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:47.879134 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7ebb-04b6-461b-ae34-5d4e43c17b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:47.889294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e7ebb-04b6-461b-ae34-5d4e43c17b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:47.890840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e7ebb-04b6-461b-ae34-5d4e43c17b63 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:47.892428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9630-53d3-4bff-8ebc-b8e005b91295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:47.893181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9630-53d3-4bff-8ebc-b8e005b91295 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:47.893535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9630-53d3-4bff-8ebc-b8e005b91295 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:47.893886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f9630-53d3-4bff-8ebc-b8e005b91295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:47.901846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1068/2126] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:47.904620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f9630-53d3-4bff-8ebc-b8e005b91295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:47.906354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f9630-53d3-4bff-8ebc-b8e005b91295 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:47.918829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1059/2127] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:50:48.273345 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7ebb-04b6-461b-ae34-5d4e43c17b63 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.274736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-1e0e7ebb-04b6-461b-ae34-5d4e43c17b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.293982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7ebb-04b6-461b-ae34-5d4e43c17b63 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.307074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.308579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.309087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.310053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] PATH_INFO: `/v3/projects/83bc84b8e4264295a93590a6ca6040e3` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.311059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bc84b8e4264295a93590a6ca6040e3)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.314598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.363819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9630-53d3-4bff-8ebc-b8e005b91295 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.365286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cc0f9630-53d3-4bff-8ebc-b8e005b91295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.379594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f9630-53d3-4bff-8ebc-b8e005b91295 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.384169 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bc84b8e4264295a93590a6ca6040e3', 'request_id': 'req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.394117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bc84b8e4264295a93590a6ca6040e3', 'request_id': 'req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.404860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bc84b8e4264295a93590a6ca6040e3', 'request_id': 'req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.423926 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] The token cache is being invalidate because project 83bc84b8e4264295a93590a6ca6040e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:48.425188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.426089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.429378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1069/2128] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:48 2022] DELETE /identity/v3/projects/83bc84b8e4264295a93590a6ca6040e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:48.431158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.432579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.460322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.461240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.461526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.461834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] PATH_INFO: `/v3/projects/656628e4e7ea4e348509fa2cf4175d8e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.463151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656628e4e7ea4e348509fa2cf4175d8e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.465282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.500681 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3a291-f3ce-44fd-adc4-c9d7814fab12 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.512304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656628e4e7ea4e348509fa2cf4175d8e', 'request_id': 'req-b5193753-da52-4891-b687-7bc948b8f104'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.519754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656628e4e7ea4e348509fa2cf4175d8e', 'request_id': 'req-b5193753-da52-4891-b687-7bc948b8f104'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.526997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656628e4e7ea4e348509fa2cf4175d8e', 'request_id': 'req-b5193753-da52-4891-b687-7bc948b8f104'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.538084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] The token cache is being invalidate because project 656628e4e7ea4e348509fa2cf4175d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:48.538494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.539023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b5193753-da52-4891-b687-7bc948b8f104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.540591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1060/2129] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:48 2022] DELETE /identity/v3/projects/656628e4e7ea4e348509fa2cf4175d8e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:48.541835 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4379d-fc58-4417-aac7-399ec99f9ab5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.542126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4379d-fc58-4417-aac7-399ec99f9ab5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.542405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4379d-fc58-4417-aac7-399ec99f9ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.561046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.561913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.562316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.562597 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] PATH_INFO: `/v3/users/0a5e14edde1f4236a2ba8e8f433ec06d` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.563684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-63b4379d-fc58-4417-aac7-399ec99f9ab5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:48.563880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5e14edde1f4236a2ba8e8f433ec06d)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.564907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-63b4379d-fc58-4417-aac7-399ec99f9ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.565841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.574855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1061/2130] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:48.576996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83200648-9d49-4c7c-881d-4833a4234246 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.577329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83200648-9d49-4c7c-881d-4833a4234246 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.577743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83200648-9d49-4c7c-881d-4833a4234246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.597522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-83200648-9d49-4c7c-881d-4833a4234246 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:48.598922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-83200648-9d49-4c7c-881d-4833a4234246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.607981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1062/2131] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:48.609520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148ad2-7e03-4050-b389-1bf52c1a1ece None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.610017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148ad2-7e03-4050-b389-1bf52c1a1ece None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.610302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e148ad2-7e03-4050-b389-1bf52c1a1ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.615117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5e14edde1f4236a2ba8e8f433ec06d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.622047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5e14edde1f4236a2ba8e8f433ec06d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.628347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9e148ad2-7e03-4050-b389-1bf52c1a1ece None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:48.629540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9e148ad2-7e03-4050-b389-1bf52c1a1ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.634540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5e14edde1f4236a2ba8e8f433ec06d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.638577 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1063/2132] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:48.640065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787c14-4691-47a0-8b7f-85330879ae67 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.640362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787c14-4691-47a0-8b7f-85330879ae67 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.640686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787c14-4691-47a0-8b7f-85330879ae67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.643379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5e14edde1f4236a2ba8e8f433ec06d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.644137 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5e14edde1f4236a2ba8e8f433ec06d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:48.651117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1070/2133] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:48 2022] DELETE /identity/v3/users/0a5e14edde1f4236a2ba8e8f433ec06d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:48.651987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.653325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.659299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ca787c14-4691-47a0-8b7f-85330879ae67 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:48.660496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ca787c14-4691-47a0-8b7f-85330879ae67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.717913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f494ae-39f8-48f9-a104-7a2b4c5d7229 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.718626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1064/2134] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:48.719811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b3f5-6377-4ea8-b031-5f9c85f9170e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.720059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b3f5-6377-4ea8-b031-5f9c85f9170e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.720341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7b3f5-6377-4ea8-b031-5f9c85f9170e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.722702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732387-0c5d-4da5-9c65-e5d5f1272389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.723355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732387-0c5d-4da5-9c65-e5d5f1272389 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.723671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732387-0c5d-4da5-9c65-e5d5f1272389 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.723979 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da732387-0c5d-4da5-9c65-e5d5f1272389 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.724745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da732387-0c5d-4da5-9c65-e5d5f1272389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:48.725184 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da732387-0c5d-4da5-9c65-e5d5f1272389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.727031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da732387-0c5d-4da5-9c65-e5d5f1272389 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.737837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e2d7b3f5-6377-4ea8-b031-5f9c85f9170e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:48.738370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1071/2135] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:50:48.739040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e2d7b3f5-6377-4ea8-b031-5f9c85f9170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.739224 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732387-0c5d-4da5-9c65-e5d5f1272389 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.747846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1065/2136] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:48.748627 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7b3f5-6377-4ea8-b031-5f9c85f9170e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.749472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da732387-0c5d-4da5-9c65-e5d5f1272389 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.754304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.754952 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.755241 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.755520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.757100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:48.757567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.759160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.759673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7b3f5-6377-4ea8-b031-5f9c85f9170e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.764314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53936-7275-4eb9-b26a-f03651b72c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.764961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53936-7275-4eb9-b26a-f03651b72c9a admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.765251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53936-7275-4eb9-b26a-f03651b72c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.765543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53936-7275-4eb9-b26a-f03651b72c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.766245 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d53936-7275-4eb9-b26a-f03651b72c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.768182 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d53936-7275-4eb9-b26a-f03651b72c9a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.774376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1072/2137] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:50:48.774376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.774376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:48.796884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1066/2138] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:48 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:48.797770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53936-7275-4eb9-b26a-f03651b72c9a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.828092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98763-d4d1-4c14-8d9a-e5bfdbdc187c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.857568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53936-7275-4eb9-b26a-f03651b72c9a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.862160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905693ad-28fc-42b8-8bfb-eac713f472df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.862810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905693ad-28fc-42b8-8bfb-eac713f472df admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.863092 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905693ad-28fc-42b8-8bfb-eac713f472df admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.863367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905693ad-28fc-42b8-8bfb-eac713f472df admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.864109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905693ad-28fc-42b8-8bfb-eac713f472df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.866665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905693ad-28fc-42b8-8bfb-eac713f472df admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.874630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d58ed6-87b8-4619-acff-836d1a8ab126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.875302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d58ed6-87b8-4619-acff-836d1a8ab126 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.875613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d58ed6-87b8-4619-acff-836d1a8ab126 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.875894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d58ed6-87b8-4619-acff-836d1a8ab126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.887001 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d58ed6-87b8-4619-acff-836d1a8ab126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.888474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d58ed6-87b8-4619-acff-836d1a8ab126 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.895953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1067/2139] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:48 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:48.895953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905693ad-28fc-42b8-8bfb-eac713f472df admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.898727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1073/2140] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:48.899515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d58ed6-87b8-4619-acff-836d1a8ab126 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:48.908913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d58ed6-87b8-4619-acff-836d1a8ab126 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.965515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905693ad-28fc-42b8-8bfb-eac713f472df admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:48.970067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c7415-ca90-4947-8598-50c1be445ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.970845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c7415-ca90-4947-8598-50c1be445ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.971141 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c7415-ca90-4947-8598-50c1be445ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.971425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c7415-ca90-4947-8598-50c1be445ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.972173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c7415-ca90-4947-8598-50c1be445ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.972914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05026d-79b7-4f6a-853b-f88103056b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:48.973601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05026d-79b7-4f6a-853b-f88103056b3b admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:48.973891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05026d-79b7-4f6a-853b-f88103056b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:48.974105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98c7415-ca90-4947-8598-50c1be445ad3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.974204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb05026d-79b7-4f6a-853b-f88103056b3b admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:48.974921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05026d-79b7-4f6a-853b-f88103056b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:48.977054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb05026d-79b7-4f6a-853b-f88103056b3b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:48.997692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1074/2141] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:48 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:49.002988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1068/2142] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:48 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:49.003136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c7415-ca90-4947-8598-50c1be445ad3 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.005494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05026d-79b7-4f6a-853b-f88103056b3b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.012510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c7415-ca90-4947-8598-50c1be445ad3 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.018133 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586998b-d045-4a49-a5bc-89b53723aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.018837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb05026d-79b7-4f6a-853b-f88103056b3b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.019240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586998b-d045-4a49-a5bc-89b53723aa06 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.019532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586998b-d045-4a49-a5bc-89b53723aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.019851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586998b-d045-4a49-a5bc-89b53723aa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.020603 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586998b-d045-4a49-a5bc-89b53723aa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.023180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586998b-d045-4a49-a5bc-89b53723aa06 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.025611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6c698-e9b5-4780-bc5f-4fa72ea80529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.026406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6c698-e9b5-4780-bc5f-4fa72ea80529 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.026758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6c698-e9b5-4780-bc5f-4fa72ea80529 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.027154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6c698-e9b5-4780-bc5f-4fa72ea80529 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.028012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6c698-e9b5-4780-bc5f-4fa72ea80529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.030162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6c698-e9b5-4780-bc5f-4fa72ea80529 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.041431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1075/2143] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:50:49.042351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586998b-d045-4a49-a5bc-89b53723aa06 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.045579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1069/2144] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:49.047154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6c698-e9b5-4780-bc5f-4fa72ea80529 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.058081 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6c698-e9b5-4780-bc5f-4fa72ea80529 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.067599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb5726-d3ed-4781-91eb-1f61b235ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.069853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb5726-d3ed-4781-91eb-1f61b235ea8f admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.072447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586998b-d045-4a49-a5bc-89b53723aa06 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.072534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb5726-d3ed-4781-91eb-1f61b235ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.073315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb5726-d3ed-4781-91eb-1f61b235ea8f admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.074140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb5726-d3ed-4781-91eb-1f61b235ea8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.075798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb5726-d3ed-4781-91eb-1f61b235ea8f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.076896 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e89c7-32d1-4d7d-85a8-faa48377e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.077724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e89c7-32d1-4d7d-85a8-faa48377e89a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.078235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e89c7-32d1-4d7d-85a8-faa48377e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.078680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e89c7-32d1-4d7d-85a8-faa48377e89a admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.079587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e89c7-32d1-4d7d-85a8-faa48377e89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.081339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e89c7-32d1-4d7d-85a8-faa48377e89a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.091089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1070/2145] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:50:49.092059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb5726-d3ed-4781-91eb-1f61b235ea8f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.096909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1076/2146] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:49.098587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e89c7-32d1-4d7d-85a8-faa48377e89a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.103366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb5726-d3ed-4781-91eb-1f61b235ea8f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.113145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e89c7-32d1-4d7d-85a8-faa48377e89a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.114304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f801b-d00f-4def-9296-148b88359250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.115218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f801b-d00f-4def-9296-148b88359250 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.115676 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f801b-d00f-4def-9296-148b88359250 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.116123 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f801b-d00f-4def-9296-148b88359250 admin admin] PATH_INFO: `/v3/projects/96856c9724a443a1af9026d9b82a1a06/users/0b91d56cc6274b63b94e71c62b083d98/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.118796 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6540041c-9559-42f8-85dd-ddd764ff20df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.120749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540041c-9559-42f8-85dd-ddd764ff20df admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.120749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540041c-9559-42f8-85dd-ddd764ff20df admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.121014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6540041c-9559-42f8-85dd-ddd764ff20df admin admin] PATH_INFO: `/v3/projects/5c13f9d51cfe44de91903d2de6032c92/users/d1189e6ca83149dc95cc1a54c3c31421/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.135374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f801b-d00f-4def-9296-148b88359250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96856c9724a443a1af9026d9b82a1a06, user_id=0b91d56cc6274b63b94e71c62b083d98, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.138268 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f801b-d00f-4def-9296-148b88359250 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.150825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540041c-9559-42f8-85dd-ddd764ff20df admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c13f9d51cfe44de91903d2de6032c92, user_id=d1189e6ca83149dc95cc1a54c3c31421, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.153701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6540041c-9559-42f8-85dd-ddd764ff20df admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.156384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1071/2147] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:49 2022] PUT /identity/v3/projects/96856c9724a443a1af9026d9b82a1a06/users/0b91d56cc6274b63b94e71c62b083d98/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:49.167279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf140f-0b25-4fdf-934e-7164e8517f35 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.167698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf140f-0b25-4fdf-934e-7164e8517f35 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.167962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf140f-0b25-4fdf-934e-7164e8517f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.181451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1077/2148] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:49 2022] PUT /identity/v3/projects/5c13f9d51cfe44de91903d2de6032c92/users/d1189e6ca83149dc95cc1a54c3c31421/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:49.187078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651cc78-c763-49a9-8f77-0acd79cd1167 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.188363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651cc78-c763-49a9-8f77-0acd79cd1167 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.189008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651cc78-c763-49a9-8f77-0acd79cd1167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.204950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-f1bf140f-0b25-4fdf-934e-7164e8517f35 None None] MFA Rules not processed for user `0b91d56cc6274b63b94e71c62b083d98`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:49.206203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f1bf140f-0b25-4fdf-934e-7164e8517f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:49.210327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b651cc78-c763-49a9-8f77-0acd79cd1167 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:49.211324 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b651cc78-c763-49a9-8f77-0acd79cd1167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:49.288348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1078/2149] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:50:49.288348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651cc78-c763-49a9-8f77-0acd79cd1167 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.288348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b651cc78-c763-49a9-8f77-0acd79cd1167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:49.302361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651cc78-c763-49a9-8f77-0acd79cd1167 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.303084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1072/2150] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:50:49.303806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf140f-0b25-4fdf-934e-7164e8517f35 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.311323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.312132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.312470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.312823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] PATH_INFO: `/v3/projects/f30ceb09fa7c4c92bb12f87d3172d1e6` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.314168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30ceb09fa7c4c92bb12f87d3172d1e6)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.316203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.364579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf140f-0b25-4fdf-934e-7164e8517f35 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.366527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30ceb09fa7c4c92bb12f87d3172d1e6', 'request_id': 'req-57562175-ec08-4644-aace-af88d2c3943c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:49.373085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30ceb09fa7c4c92bb12f87d3172d1e6', 'request_id': 'req-57562175-ec08-4644-aace-af88d2c3943c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:49.378782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30ceb09fa7c4c92bb12f87d3172d1e6', 'request_id': 'req-57562175-ec08-4644-aace-af88d2c3943c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:49.393671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] The token cache is being invalidate because project f30ceb09fa7c4c92bb12f87d3172d1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:49.393960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:49.394614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:49.399621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1079/2151] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:49 2022] DELETE /identity/v3/projects/f30ceb09fa7c4c92bb12f87d3172d1e6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:50:49.399621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.399879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:49.429931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eaee63-7b01-48b3-a4af-3f6d3fef2832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.430578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaee63-7b01-48b3-a4af-3f6d3fef2832 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.430862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaee63-7b01-48b3-a4af-3f6d3fef2832 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.431251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaee63-7b01-48b3-a4af-3f6d3fef2832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.433111 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f5eaee63-7b01-48b3-a4af-3f6d3fef2832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:49.471410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57562175-ec08-4644-aace-af88d2c3943c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.476482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3be17-56c5-42d6-81c5-ceea1641bef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.476982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3be17-56c5-42d6-81c5-ceea1641bef4 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.477270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3be17-56c5-42d6-81c5-ceea1641bef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.477550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3be17-56c5-42d6-81c5-ceea1641bef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.479774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-55a3be17-56c5-42d6-81c5-ceea1641bef4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:49.506878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eaee63-7b01-48b3-a4af-3f6d3fef2832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.510947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eaee63-7b01-48b3-a4af-3f6d3fef2832 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.525505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1073/2152] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:49.527041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac7387-ad3e-46c1-8ac3-9be6a743db34 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.527601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac7387-ad3e-46c1-8ac3-9be6a743db34 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.527900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac7387-ad3e-46c1-8ac3-9be6a743db34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.558694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a3ac7387-ad3e-46c1-8ac3-9be6a743db34 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:49.560215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a3ac7387-ad3e-46c1-8ac3-9be6a743db34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:49.571936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1074/2153] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:49.580516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec95cbb-d7f3-47a9-ba96-acf1d995a475 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.580953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec95cbb-d7f3-47a9-ba96-acf1d995a475 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.581334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec95cbb-d7f3-47a9-ba96-acf1d995a475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.610696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-2ec95cbb-d7f3-47a9-ba96-acf1d995a475 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:49.612161 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2ec95cbb-d7f3-47a9-ba96-acf1d995a475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:49.633643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1075/2154] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:49.637889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec95cbb-d7f3-47a9-ba96-acf1d995a475 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.641300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3be17-56c5-42d6-81c5-ceea1641bef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.642759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3be17-56c5-42d6-81c5-ceea1641bef4 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.651902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec95cbb-d7f3-47a9-ba96-acf1d995a475 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.653725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1080/2155] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:49.665699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e930d07-1fcf-4661-af37-43bd10f521be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.666471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e930d07-1fcf-4661-af37-43bd10f521be admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.666829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e930d07-1fcf-4661-af37-43bd10f521be admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.667201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e930d07-1fcf-4661-af37-43bd10f521be admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.668221 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e930d07-1fcf-4661-af37-43bd10f521be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:49.668656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e930d07-1fcf-4661-af37-43bd10f521be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.670416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e930d07-1fcf-4661-af37-43bd10f521be admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.684671 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1076/2156] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:50:49.689492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3be17-56c5-42d6-81c5-ceea1641bef4 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.703191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3be17-56c5-42d6-81c5-ceea1641bef4 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.708892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c19a-362b-459d-92e8-9ddb99edb2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.710501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c19a-362b-459d-92e8-9ddb99edb2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.710651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c19a-362b-459d-92e8-9ddb99edb2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.710880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31c19a-362b-459d-92e8-9ddb99edb2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.711635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c19a-362b-459d-92e8-9ddb99edb2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.714228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31c19a-362b-459d-92e8-9ddb99edb2e0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.749911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1081/2157] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:49 2022] POST /identity/v3/projects => generated 361 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:50:49.753958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e930d07-1fcf-4661-af37-43bd10f521be admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.771121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e930d07-1fcf-4661-af37-43bd10f521be admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.860923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e015373-504f-480a-be41-359ee5028535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.861505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e015373-504f-480a-be41-359ee5028535 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.861840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e015373-504f-480a-be41-359ee5028535 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.862120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e015373-504f-480a-be41-359ee5028535 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.862877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e015373-504f-480a-be41-359ee5028535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.864839 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e015373-504f-480a-be41-359ee5028535 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.891294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1077/2158] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:49 2022] POST /identity/v3/users => generated 281 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:49.892726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c19a-362b-459d-92e8-9ddb99edb2e0 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.904022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31c19a-362b-459d-92e8-9ddb99edb2e0 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.909463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78a270-86a4-4d28-aa80-bcb09344f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.910283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78a270-86a4-4d28-aa80-bcb09344f51c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.910795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78a270-86a4-4d28-aa80-bcb09344f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.911127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78a270-86a4-4d28-aa80-bcb09344f51c admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.911967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78a270-86a4-4d28-aa80-bcb09344f51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.914729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78a270-86a4-4d28-aa80-bcb09344f51c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.930571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1082/2159] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:50:49.932163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e015373-504f-480a-be41-359ee5028535 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.942747 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e015373-504f-480a-be41-359ee5028535 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.949538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f6b7f-103e-4c9e-a710-ce2638497297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.949848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f6b7f-103e-4c9e-a710-ce2638497297 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.949848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f6b7f-103e-4c9e-a710-ce2638497297 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.950170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f6b7f-103e-4c9e-a710-ce2638497297 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:49.951349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f6b7f-103e-4c9e-a710-ce2638497297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:49.953156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f6b7f-103e-4c9e-a710-ce2638497297 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:49.965244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1078/2160] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:49.969401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78a270-86a4-4d28-aa80-bcb09344f51c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:49.981608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78a270-86a4-4d28-aa80-bcb09344f51c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:49.987637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a2547-aadf-4ad1-860a-a611bf40831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:49.988670 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a2547-aadf-4ad1-860a-a611bf40831a admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:49.989357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a2547-aadf-4ad1-860a-a611bf40831a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:49.989717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a2547-aadf-4ad1-860a-a611bf40831a admin admin] PATH_INFO: `/v3/projects/17fb423a4b254911b0440bc5fad574e8/users/84b792be4d8c40b3853330f1991f7a71/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:50.016524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a2547-aadf-4ad1-860a-a611bf40831a admin admin] RBAC: Authorizing `identity:create_grant(project_id=17fb423a4b254911b0440bc5fad574e8, user_id=84b792be4d8c40b3853330f1991f7a71, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:50.019938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a2547-aadf-4ad1-860a-a611bf40831a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:50.045745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1083/2161] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:49 2022] PUT /identity/v3/projects/17fb423a4b254911b0440bc5fad574e8/users/84b792be4d8c40b3853330f1991f7a71/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:50.058133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282e861-b901-4215-88c3-18e35fce35a0 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:50.058422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282e861-b901-4215-88c3-18e35fce35a0 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:50.058703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282e861-b901-4215-88c3-18e35fce35a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:50.102568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-a282e861-b901-4215-88c3-18e35fce35a0 None None] MFA Rules not processed for user `84b792be4d8c40b3853330f1991f7a71`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:50.105078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a282e861-b901-4215-88c3-18e35fce35a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:50.196626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1079/2162] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:50.226404 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a2547-aadf-4ad1-860a-a611bf40831a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:50.228264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-127a2547-aadf-4ad1-860a-a611bf40831a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:50.289704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a2547-aadf-4ad1-860a-a611bf40831a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:50.294282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f152c8-2d89-4b0e-b6e7-ca03e1e4651e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:50.295016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f152c8-2d89-4b0e-b6e7-ca03e1e4651e service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:50.295325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f152c8-2d89-4b0e-b6e7-ca03e1e4651e service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:50.295759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f152c8-2d89-4b0e-b6e7-ca03e1e4651e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:50.305853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f152c8-2d89-4b0e-b6e7-ca03e1e4651e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:50.307279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f152c8-2d89-4b0e-b6e7-ca03e1e4651e service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:50.316349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1084/2163] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:50.330699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282e861-b901-4215-88c3-18e35fce35a0 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:50.431601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282e861-b901-4215-88c3-18e35fce35a0 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:50.440977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:50.442168 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:50.444176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:50.444594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] PATH_INFO: `/v3/users/84b792be4d8c40b3853330f1991f7a71` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:50.446397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84b792be4d8c40b3853330f1991f7a71)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:50.450052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:50.511397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84b792be4d8c40b3853330f1991f7a71'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:50.520678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84b792be4d8c40b3853330f1991f7a71'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:50.521417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84b792be4d8c40b3853330f1991f7a71'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:50.545080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84b792be4d8c40b3853330f1991f7a71'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:50.557955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84b792be4d8c40b3853330f1991f7a71'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:50.567700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1080/2164] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:50:50 2022] DELETE /identity/v3/users/84b792be4d8c40b3853330f1991f7a71 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:50.572162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5007fc5-4250-4152-81a2-e5372f36a012 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:50.572748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5007fc5-4250-4152-81a2-e5372f36a012 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:50.573244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5007fc5-4250-4152-81a2-e5372f36a012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:50.592263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-f5007fc5-4250-4152-81a2-e5372f36a012 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:50.593805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f5007fc5-4250-4152-81a2-e5372f36a012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:50.658431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1085/2165] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:50.668995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:50.670439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:50.756394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05220b65-9534-4c19-aea1-a9d7ed692bb2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:50.764799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f68cc6-2079-433b-9720-25bdf6e66322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:50.765630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f68cc6-2079-433b-9720-25bdf6e66322 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:50.766033 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f68cc6-2079-433b-9720-25bdf6e66322 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:50.766404 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f68cc6-2079-433b-9720-25bdf6e66322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:50.785328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f68cc6-2079-433b-9720-25bdf6e66322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:50.786925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f68cc6-2079-433b-9720-25bdf6e66322 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:50.809273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1081/2166] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:51.152334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5007fc5-4250-4152-81a2-e5372f36a012 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:51.154031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f5007fc5-4250-4152-81a2-e5372f36a012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:51.181344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5007fc5-4250-4152-81a2-e5372f36a012 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:51.200895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:51.202173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:51.202641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:51.203199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] PATH_INFO: `/v3/projects/17fb423a4b254911b0440bc5fad574e8` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:51.205086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=17fb423a4b254911b0440bc5fad574e8)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:51.209270 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:51.296310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17fb423a4b254911b0440bc5fad574e8', 'request_id': 'req-ca55329f-39eb-42a5-8177-18fc1ef27aae'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:51.306109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17fb423a4b254911b0440bc5fad574e8', 'request_id': 'req-ca55329f-39eb-42a5-8177-18fc1ef27aae'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:51.313580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17fb423a4b254911b0440bc5fad574e8', 'request_id': 'req-ca55329f-39eb-42a5-8177-18fc1ef27aae'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:51.333237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] The token cache is being invalidate because project 17fb423a4b254911b0440bc5fad574e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:50:51.333536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:51.335431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ca55329f-39eb-42a5-8177-18fc1ef27aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:50:51.337849 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1086/2167] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:50:51 2022] DELETE /identity/v3/projects/17fb423a4b254911b0440bc5fad574e8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:51.344547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382698c-e52c-42f7-baf7-e94978b7a73b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:51.345062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382698c-e52c-42f7-baf7-e94978b7a73b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:51.347727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382698c-e52c-42f7-baf7-e94978b7a73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:51.369944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d382698c-e52c-42f7-baf7-e94978b7a73b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:51.371613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d382698c-e52c-42f7-baf7-e94978b7a73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:51.529680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19936c-0584-4990-9e73-6fb59a6648c5 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:51.532837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19936c-0584-4990-9e73-6fb59a6648c5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:51.533437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19936c-0584-4990-9e73-6fb59a6648c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:51.539311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1082/2168] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:51.602549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ce19936c-0584-4990-9e73-6fb59a6648c5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:51.604430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ce19936c-0584-4990-9e73-6fb59a6648c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:51.616611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1087/2169] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:51.618264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382698c-e52c-42f7-baf7-e94978b7a73b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:51.634396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382698c-e52c-42f7-baf7-e94978b7a73b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:51.650152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394cb7-3601-498c-bdee-5f8311570a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:51.651987 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394cb7-3601-498c-bdee-5f8311570a32 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:51.652279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394cb7-3601-498c-bdee-5f8311570a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:51.653319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394cb7-3601-498c-bdee-5f8311570a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:51.654078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36394cb7-3601-498c-bdee-5f8311570a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:50:51.654302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36394cb7-3601-498c-bdee-5f8311570a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:51.659329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36394cb7-3601-498c-bdee-5f8311570a32 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:51.692596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1083/2170] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:50:51.696189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19936c-0584-4990-9e73-6fb59a6648c5 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:51.719008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19936c-0584-4990-9e73-6fb59a6648c5 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:51.726375 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f3b4f-3199-4331-95f4-525ba5e8b229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:51.727692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3b4f-3199-4331-95f4-525ba5e8b229 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:51.728360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3b4f-3199-4331-95f4-525ba5e8b229 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:51.729240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f3b4f-3199-4331-95f4-525ba5e8b229 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:51.730894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f3b4f-3199-4331-95f4-525ba5e8b229 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:51.733769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f3b4f-3199-4331-95f4-525ba5e8b229 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:51.773365 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1088/2171] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:51 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:51.778103 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394cb7-3601-498c-bdee-5f8311570a32 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:51.790211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394cb7-3601-498c-bdee-5f8311570a32 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:51.910213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc875c9-8a76-4cb2-b237-bb4e0bcf55fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:51.911656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc875c9-8a76-4cb2-b237-bb4e0bcf55fb admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:51.912236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc875c9-8a76-4cb2-b237-bb4e0bcf55fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:51.912607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc875c9-8a76-4cb2-b237-bb4e0bcf55fb admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:51.913707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc875c9-8a76-4cb2-b237-bb4e0bcf55fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:51.917786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc875c9-8a76-4cb2-b237-bb4e0bcf55fb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:51.945891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1084/2172] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:51 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:51.947425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f3b4f-3199-4331-95f4-525ba5e8b229 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:51.957698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f3b4f-3199-4331-95f4-525ba5e8b229 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:51.963020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6eae3-05fb-4d22-9735-fd7d171a965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:51.963726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6eae3-05fb-4d22-9735-fd7d171a965d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:51.964013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6eae3-05fb-4d22-9735-fd7d171a965d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:51.964293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd6eae3-05fb-4d22-9735-fd7d171a965d admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:51.965040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6eae3-05fb-4d22-9735-fd7d171a965d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:51.966637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd6eae3-05fb-4d22-9735-fd7d171a965d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:51.978332 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1089/2173] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:51.982277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc875c9-8a76-4cb2-b237-bb4e0bcf55fb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:51.993064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc875c9-8a76-4cb2-b237-bb4e0bcf55fb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:51.998534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209eb2f5-6eaf-414b-97de-fec9a66dd8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:51.999360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eb2f5-6eaf-414b-97de-fec9a66dd8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:51.999894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eb2f5-6eaf-414b-97de-fec9a66dd8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:52.000184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209eb2f5-6eaf-414b-97de-fec9a66dd8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:52.000967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eb2f5-6eaf-414b-97de-fec9a66dd8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:52.002596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209eb2f5-6eaf-414b-97de-fec9a66dd8f9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:52.014212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1085/2174] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:50:52.018319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6eae3-05fb-4d22-9735-fd7d171a965d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:52.030010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd6eae3-05fb-4d22-9735-fd7d171a965d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:52.035976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d8578-00b6-40fd-8991-0408d0e77986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:52.037061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d8578-00b6-40fd-8991-0408d0e77986 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:52.038090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d8578-00b6-40fd-8991-0408d0e77986 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:52.038609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d8578-00b6-40fd-8991-0408d0e77986 admin admin] PATH_INFO: `/v3/projects/a92d0592f8f14b89a36b145413b2fbe1/users/8c67a45bdb0d4dcfbd59e88c6eb6f7f5/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:52.054564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d8578-00b6-40fd-8991-0408d0e77986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92d0592f8f14b89a36b145413b2fbe1, user_id=8c67a45bdb0d4dcfbd59e88c6eb6f7f5, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:52.061253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d8578-00b6-40fd-8991-0408d0e77986 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:52.079374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1090/2175] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:52 2022] PUT /identity/v3/projects/a92d0592f8f14b89a36b145413b2fbe1/users/8c67a45bdb0d4dcfbd59e88c6eb6f7f5/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:52.083798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ceacc-d300-4a64-8b0e-3f72a03780ea None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:52.084158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ceacc-d300-4a64-8b0e-3f72a03780ea None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:52.084444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ceacc-d300-4a64-8b0e-3f72a03780ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:52.107291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d62ceacc-d300-4a64-8b0e-3f72a03780ea None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:52.109088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d62ceacc-d300-4a64-8b0e-3f72a03780ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:52.196657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1086/2176] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:52.206370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d8578-00b6-40fd-8991-0408d0e77986 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:52.208309 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-511d8578-00b6-40fd-8991-0408d0e77986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:52.283511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d8578-00b6-40fd-8991-0408d0e77986 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:52.289787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c854bc2-31e7-4dd2-b0e2-101414441615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:52.290757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c854bc2-31e7-4dd2-b0e2-101414441615 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:52.291197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c854bc2-31e7-4dd2-b0e2-101414441615 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:52.292239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c854bc2-31e7-4dd2-b0e2-101414441615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:52.305742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c854bc2-31e7-4dd2-b0e2-101414441615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:52.307381 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c854bc2-31e7-4dd2-b0e2-101414441615 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:52.319167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1091/2177] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:53.569146 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb8d82-20b9-42b0-a8b8-4488d25e2e3e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:53.569687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb8d82-20b9-42b0-a8b8-4488d25e2e3e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:53.569937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb8d82-20b9-42b0-a8b8-4488d25e2e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:53.625685 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-26cb8d82-20b9-42b0-a8b8-4488d25e2e3e None None] MFA Rules not processed for user `8c67a45bdb0d4dcfbd59e88c6eb6f7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:53.626976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-26cb8d82-20b9-42b0-a8b8-4488d25e2e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:53.750894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1087/2178] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:53.761369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c854bc2-31e7-4dd2-b0e2-101414441615 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:53.763163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0c854bc2-31e7-4dd2-b0e2-101414441615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:53.873410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c854bc2-31e7-4dd2-b0e2-101414441615 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:53.877751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417bcde-be2a-4645-90cd-d96981ef500b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:53.878450 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417bcde-be2a-4645-90cd-d96981ef500b service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:53.878730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417bcde-be2a-4645-90cd-d96981ef500b service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:53.878998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3417bcde-be2a-4645-90cd-d96981ef500b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:53.890573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417bcde-be2a-4645-90cd-d96981ef500b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:53.892441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3417bcde-be2a-4645-90cd-d96981ef500b service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:53.903445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1092/2179] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:50:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:50:55.288061 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4abaf-2ddc-4483-a395-6be6f2cc6e09 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:55.288942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4abaf-2ddc-4483-a395-6be6f2cc6e09 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:55.289376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4abaf-2ddc-4483-a395-6be6f2cc6e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:55.322007 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-3ab4abaf-2ddc-4483-a395-6be6f2cc6e09 None None] MFA Rules not processed for user `d1189e6ca83149dc95cc1a54c3c31421`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:55.323743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3ab4abaf-2ddc-4483-a395-6be6f2cc6e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:55.399019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1088/2180] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:55.403121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417bcde-be2a-4645-90cd-d96981ef500b service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:55.404859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3417bcde-be2a-4645-90cd-d96981ef500b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:55.419743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3417bcde-be2a-4645-90cd-d96981ef500b service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:55.424961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712a2b7-fbee-42fc-9abe-1e63fac79f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:55.425859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712a2b7-fbee-42fc-9abe-1e63fac79f82 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:55.426327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712a2b7-fbee-42fc-9abe-1e63fac79f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:55.426785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712a2b7-fbee-42fc-9abe-1e63fac79f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:55.428504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712a2b7-fbee-42fc-9abe-1e63fac79f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:55.430833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712a2b7-fbee-42fc-9abe-1e63fac79f82 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:55.452578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b91e-f73f-4e6b-8864-f51f3f9717bb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:55.452948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b91e-f73f-4e6b-8864-f51f3f9717bb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:55.453297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989b91e-f73f-4e6b-8864-f51f3f9717bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:55.463821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1093/2181] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:50:55 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:50:55.467494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712a2b7-fbee-42fc-9abe-1e63fac79f82 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:55.474293 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-0989b91e-f73f-4e6b-8864-f51f3f9717bb None None] MFA Rules not processed for user `8c67a45bdb0d4dcfbd59e88c6eb6f7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:50:55.476208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0989b91e-f73f-4e6b-8864-f51f3f9717bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:50:55.547923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712a2b7-fbee-42fc-9abe-1e63fac79f82 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:55.553713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e83ac-5eef-4afb-b308-c90eecda2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:55.554528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e83ac-5eef-4afb-b308-c90eecda2524 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:55.554911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e83ac-5eef-4afb-b308-c90eecda2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:55.555344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e83ac-5eef-4afb-b308-c90eecda2524 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:55.556138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e83ac-5eef-4afb-b308-c90eecda2524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:55.558179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e83ac-5eef-4afb-b308-c90eecda2524 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:55.567400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1089/2182] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:50:55.595771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1094/2183] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:50:55 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:50:55.596991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989b91e-f73f-4e6b-8864-f51f3f9717bb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:55.610594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989b91e-f73f-4e6b-8864-f51f3f9717bb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:55.617376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db872eb-b736-432c-8eee-b08068250069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:55.618281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db872eb-b736-432c-8eee-b08068250069 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:55.618630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db872eb-b736-432c-8eee-b08068250069 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:55.619172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db872eb-b736-432c-8eee-b08068250069 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:55.620121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db872eb-b736-432c-8eee-b08068250069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:55.622013 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db872eb-b736-432c-8eee-b08068250069 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:55.647774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1090/2184] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:50:55.649069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e83ac-5eef-4afb-b308-c90eecda2524 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:55.664458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e83ac-5eef-4afb-b308-c90eecda2524 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:55.674981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230b265-73dd-4c66-b302-291b2f3a8f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:55.677280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230b265-73dd-4c66-b302-291b2f3a8f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:55.678400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230b265-73dd-4c66-b302-291b2f3a8f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:55.678845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230b265-73dd-4c66-b302-291b2f3a8f4c admin admin] PATH_INFO: `/v3/projects/63cea5ab5c644c2ba6badb6d25b3dbdc/users/69c74a11c13a4f6e8155bf109d9015d0/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:55.702906 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230b265-73dd-4c66-b302-291b2f3a8f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cea5ab5c644c2ba6badb6d25b3dbdc, user_id=69c74a11c13a4f6e8155bf109d9015d0, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:55.705922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230b265-73dd-4c66-b302-291b2f3a8f4c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:55.726468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1095/2185] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:55 2022] PUT /identity/v3/projects/63cea5ab5c644c2ba6badb6d25b3dbdc/users/69c74a11c13a4f6e8155bf109d9015d0/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:50:55.727652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db872eb-b736-432c-8eee-b08068250069 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:55.738879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db872eb-b736-432c-8eee-b08068250069 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:55.809694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd106db6-2cb1-4ad5-82cd-6d6a257cb7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:55.810619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd106db6-2cb1-4ad5-82cd-6d6a257cb7da admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:55.811077 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd106db6-2cb1-4ad5-82cd-6d6a257cb7da admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:55.811507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd106db6-2cb1-4ad5-82cd-6d6a257cb7da admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:55.812431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd106db6-2cb1-4ad5-82cd-6d6a257cb7da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:55.815019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd106db6-2cb1-4ad5-82cd-6d6a257cb7da admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:55.827618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1091/2186] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:50:55.831407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230b265-73dd-4c66-b302-291b2f3a8f4c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:50:55.846307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230b265-73dd-4c66-b302-291b2f3a8f4c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:50:55.852471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265330f0-9e3c-4cda-8039-ae8930fe4bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:50:55.853473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265330f0-9e3c-4cda-8039-ae8930fe4bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:50:55.854819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265330f0-9e3c-4cda-8039-ae8930fe4bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:50:55.855190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265330f0-9e3c-4cda-8039-ae8930fe4bb6 admin admin] PATH_INFO: `/v3/projects/63cea5ab5c644c2ba6badb6d25b3dbdc/users/69c74a11c13a4f6e8155bf109d9015d0/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:50:55.857805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265330f0-9e3c-4cda-8039-ae8930fe4bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cea5ab5c644c2ba6badb6d25b3dbdc, user_id=69c74a11c13a4f6e8155bf109d9015d0, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:50:55.860649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265330f0-9e3c-4cda-8039-ae8930fe4bb6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:50:55.882817 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1096/2187] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:50:55 2022] PUT /identity/v3/projects/63cea5ab5c644c2ba6badb6d25b3dbdc/users/69c74a11c13a4f6e8155bf109d9015d0/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:01.172699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd106db6-2cb1-4ad5-82cd-6d6a257cb7da admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:01.174787 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-dd106db6-2cb1-4ad5-82cd-6d6a257cb7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:01.198015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd106db6-2cb1-4ad5-82cd-6d6a257cb7da admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:01.336673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:01.337584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:01.338042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:01.338468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] PATH_INFO: `/v3/users/0b91d56cc6274b63b94e71c62b083d98` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:01.340303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b91d56cc6274b63b94e71c62b083d98)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:01.343742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:01.458124 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b91d56cc6274b63b94e71c62b083d98'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:01.489321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b91d56cc6274b63b94e71c62b083d98'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:01.490627 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b91d56cc6274b63b94e71c62b083d98'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:01.525594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b91d56cc6274b63b94e71c62b083d98'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:01.542752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b91d56cc6274b63b94e71c62b083d98'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:01.575445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1092/2188] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:01 2022] DELETE /identity/v3/users/0b91d56cc6274b63b94e71c62b083d98 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:01.580749 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4933e-5126-421c-a3dd-387f77130f14 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:01.581643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4933e-5126-421c-a3dd-387f77130f14 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:01.581932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4933e-5126-421c-a3dd-387f77130f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:01.622261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d8b4933e-5126-421c-a3dd-387f77130f14 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:01.623765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d8b4933e-5126-421c-a3dd-387f77130f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:01.772995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1097/2189] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:01.786625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:01.788681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:01.914808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2526-5f63-4ba5-89d8-dc9d90e2aaa5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:01.920663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38cced-ed63-4597-bec7-6fe060ee616e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:01.921660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38cced-ed63-4597-bec7-6fe060ee616e service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:01.921817 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38cced-ed63-4597-bec7-6fe060ee616e service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:01.922101 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38cced-ed63-4597-bec7-6fe060ee616e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:01.946860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38cced-ed63-4597-bec7-6fe060ee616e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:01.948392 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38cced-ed63-4597-bec7-6fe060ee616e service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:01.970102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1093/2190] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:02.649123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4933e-5126-421c-a3dd-387f77130f14 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:02.650690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d8b4933e-5126-421c-a3dd-387f77130f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:02.669793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4933e-5126-421c-a3dd-387f77130f14 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:02.686306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:02.690417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:02.690988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:02.691874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] PATH_INFO: `/v3/projects/96856c9724a443a1af9026d9b82a1a06` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:02.737546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96856c9724a443a1af9026d9b82a1a06)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:02.739621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:02.862078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96856c9724a443a1af9026d9b82a1a06', 'request_id': 'req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:02.881503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96856c9724a443a1af9026d9b82a1a06', 'request_id': 'req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:02.888381 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96856c9724a443a1af9026d9b82a1a06', 'request_id': 'req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:02.913663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] The token cache is being invalidate because project 96856c9724a443a1af9026d9b82a1a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:02.913975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:02.914715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-32df3a2b-1bb2-4b81-aab9-f5d9f50dcd91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:02.918431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1098/2191] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:02 2022] DELETE /identity/v3/projects/96856c9724a443a1af9026d9b82a1a06 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:02.924091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed255eb-2a9b-4be0-ac77-5e42d7d38ec0 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:02.924638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed255eb-2a9b-4be0-ac77-5e42d7d38ec0 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:02.924638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed255eb-2a9b-4be0-ac77-5e42d7d38ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:02.984636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-7ed255eb-2a9b-4be0-ac77-5e42d7d38ec0 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:02.985850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7ed255eb-2a9b-4be0-ac77-5e42d7d38ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:03.073690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1094/2192] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:03.081174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022bf6-bff4-4b2c-bc94-1dc64b026e07 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.081698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022bf6-bff4-4b2c-bc94-1dc64b026e07 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.081698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022bf6-bff4-4b2c-bc94-1dc64b026e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.107411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-57022bf6-bff4-4b2c-bc94-1dc64b026e07 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:03.108951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-57022bf6-bff4-4b2c-bc94-1dc64b026e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:03.119635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1099/2193] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:51:03.134728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed255eb-2a9b-4be0-ac77-5e42d7d38ec0 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:03.157811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed255eb-2a9b-4be0-ac77-5e42d7d38ec0 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:03.163031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa51e07-5843-4423-a85c-0e41287e8d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:03.163763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa51e07-5843-4423-a85c-0e41287e8d3e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.164055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa51e07-5843-4423-a85c-0e41287e8d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.164330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa51e07-5843-4423-a85c-0e41287e8d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.165874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa51e07-5843-4423-a85c-0e41287e8d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:51:03.166224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa51e07-5843-4423-a85c-0e41287e8d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:03.174875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa51e07-5843-4423-a85c-0e41287e8d3e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:03.189698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1095/2194] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:51:03.194044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022bf6-bff4-4b2c-bc94-1dc64b026e07 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:03.207093 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022bf6-bff4-4b2c-bc94-1dc64b026e07 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:03.213485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c253c-2321-477b-a70b-f36f0664e5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:03.214188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c253c-2321-477b-a70b-f36f0664e5ee admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.214475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c253c-2321-477b-a70b-f36f0664e5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.214747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c253c-2321-477b-a70b-f36f0664e5ee admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.215472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c253c-2321-477b-a70b-f36f0664e5ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:03.217478 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c253c-2321-477b-a70b-f36f0664e5ee admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:03.256462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1100/2195] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:03 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:03.259792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa51e07-5843-4423-a85c-0e41287e8d3e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:03.269986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa51e07-5843-4423-a85c-0e41287e8d3e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:03.343729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e224-a073-418b-b23c-a2c562108374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:03.344769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e224-a073-418b-b23c-a2c562108374 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.345635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e224-a073-418b-b23c-a2c562108374 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.345930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e224-a073-418b-b23c-a2c562108374 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.346720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56e224-a073-418b-b23c-a2c562108374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:03.348796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56e224-a073-418b-b23c-a2c562108374 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:03.373982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1096/2196] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:03 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:03.379458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c253c-2321-477b-a70b-f36f0664e5ee admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:03.392991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c253c-2321-477b-a70b-f36f0664e5ee admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:03.400873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5a13a-da61-4f43-9055-f21de9438526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:03.401567 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5a13a-da61-4f43-9055-f21de9438526 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.401857 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5a13a-da61-4f43-9055-f21de9438526 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.402140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5a13a-da61-4f43-9055-f21de9438526 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.402897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5a13a-da61-4f43-9055-f21de9438526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:03.404560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5a13a-da61-4f43-9055-f21de9438526 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:03.420132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1101/2197] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:03.420963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e224-a073-418b-b23c-a2c562108374 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:03.435262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e224-a073-418b-b23c-a2c562108374 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:03.448412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfc5e9-6f87-4d72-8323-1f1d842df3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:03.449262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfc5e9-6f87-4d72-8323-1f1d842df3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.449799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfc5e9-6f87-4d72-8323-1f1d842df3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.450148 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfc5e9-6f87-4d72-8323-1f1d842df3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.451102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfc5e9-6f87-4d72-8323-1f1d842df3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:03.452838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfc5e9-6f87-4d72-8323-1f1d842df3b3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:03.472972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1097/2198] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:51:03.477903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5a13a-da61-4f43-9055-f21de9438526 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:03.495014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5a13a-da61-4f43-9055-f21de9438526 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:03.501651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0f40a-90fd-449c-8580-4283ef358ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:03.502713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0f40a-90fd-449c-8580-4283ef358ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.503100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0f40a-90fd-449c-8580-4283ef358ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.503482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0f40a-90fd-449c-8580-4283ef358ffa admin admin] PATH_INFO: `/v3/projects/5f4ae6dda115477db147059df89ad002/users/7f0c0ea1e431437880ed43ef1c9cb1bb/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.524325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0f40a-90fd-449c-8580-4283ef358ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4ae6dda115477db147059df89ad002, user_id=7f0c0ea1e431437880ed43ef1c9cb1bb, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:03.527165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0f40a-90fd-449c-8580-4283ef358ffa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:03.575669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1102/2199] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:03 2022] PUT /identity/v3/projects/5f4ae6dda115477db147059df89ad002/users/7f0c0ea1e431437880ed43ef1c9cb1bb/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:03.578415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ca609-dcf0-479d-8ecd-a71baf30b0dd None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.578828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ca609-dcf0-479d-8ecd-a71baf30b0dd None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.579218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ca609-dcf0-479d-8ecd-a71baf30b0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.628732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-8c8ca609-dcf0-479d-8ecd-a71baf30b0dd None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:03.632348 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8c8ca609-dcf0-479d-8ecd-a71baf30b0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:03.722562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1098/2200] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:03.725233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea0526-b786-42ae-b35c-02bd329a0ca7 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.726048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea0526-b786-42ae-b35c-02bd329a0ca7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.726326 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea0526-b786-42ae-b35c-02bd329a0ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.733225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ca609-dcf0-479d-8ecd-a71baf30b0dd None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:03.736554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8c8ca609-dcf0-479d-8ecd-a71baf30b0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:03.771999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-1dea0526-b786-42ae-b35c-02bd329a0ca7 None None] MFA Rules not processed for user `69c74a11c13a4f6e8155bf109d9015d0`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:03.773646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-1dea0526-b786-42ae-b35c-02bd329a0ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:03.823559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ca609-dcf0-479d-8ecd-a71baf30b0dd None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:03.828624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47d55c-0078-43fb-a4c0-1f8793f94802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:03.829501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47d55c-0078-43fb-a4c0-1f8793f94802 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:03.829863 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47d55c-0078-43fb-a4c0-1f8793f94802 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:03.830220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47d55c-0078-43fb-a4c0-1f8793f94802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:03.844223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47d55c-0078-43fb-a4c0-1f8793f94802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:03.845681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf47d55c-0078-43fb-a4c0-1f8793f94802 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:03.858436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1103/2201] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:51:03.867784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1099/2202] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:51:03.871737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea0526-b786-42ae-b35c-02bd329a0ca7 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:03.873742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-1dea0526-b786-42ae-b35c-02bd329a0ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:03.993505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea0526-b786-42ae-b35c-02bd329a0ca7 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:04.004795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:04.007102 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:04.007475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:04.007864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:04.010934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:04.097504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:04.100104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:04.127042 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1104/2203] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:04.734625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d9f88-8d42-4c35-99a1-9547db8034a7 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:04.735150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d9f88-8d42-4c35-99a1-9547db8034a7 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:04.735378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d9f88-8d42-4c35-99a1-9547db8034a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:04.771901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-f24d9f88-8d42-4c35-99a1-9547db8034a7 None None] MFA Rules not processed for user `7f0c0ea1e431437880ed43ef1c9cb1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:04.773483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f24d9f88-8d42-4c35-99a1-9547db8034a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:04.877755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1100/2204] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:04.885029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:04.886622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:04.973409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c20434-467e-48f6-bf97-b8ba27018e9e service nova] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:04.979029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42805971-b488-46da-ab66-c3b27106aad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:04.979850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42805971-b488-46da-ab66-c3b27106aad8 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:04.980671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42805971-b488-46da-ab66-c3b27106aad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:04.980671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42805971-b488-46da-ab66-c3b27106aad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:05.001415 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42805971-b488-46da-ab66-c3b27106aad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:05.003232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42805971-b488-46da-ab66-c3b27106aad8 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:05.016523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1105/2205] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:05.779650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f019031-a47b-4963-863c-af943fcfacc2 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:05.781291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f019031-a47b-4963-863c-af943fcfacc2 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:05.781588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f019031-a47b-4963-863c-af943fcfacc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:05.801824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-7f019031-a47b-4963-863c-af943fcfacc2 None None] MFA Rules not processed for user `d1189e6ca83149dc95cc1a54c3c31421`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:05.804065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7f019031-a47b-4963-863c-af943fcfacc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:05.811197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1101/2206] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:06.613780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f74b6-043a-4948-961d-479eb18a6d07 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:06.614676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f74b6-043a-4948-961d-479eb18a6d07 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:06.614950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f74b6-043a-4948-961d-479eb18a6d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:06.633939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b44f74b6-043a-4948-961d-479eb18a6d07 None None] MFA Rules not processed for user `7f0c0ea1e431437880ed43ef1c9cb1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:06.635150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b44f74b6-043a-4948-961d-479eb18a6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:06.642895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1106/2207] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:17.436646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99183da3-f84a-4dfc-a615-05951eda5cb1 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:17.437205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99183da3-f84a-4dfc-a615-05951eda5cb1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:17.437364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99183da3-f84a-4dfc-a615-05951eda5cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:17.455985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-99183da3-f84a-4dfc-a615-05951eda5cb1 None None] MFA Rules not processed for user `8c67a45bdb0d4dcfbd59e88c6eb6f7f5`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:17.457442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-99183da3-f84a-4dfc-a615-05951eda5cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:17.522948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1102/2208] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:25.582840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f74b6-043a-4948-961d-479eb18a6d07 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:25.585142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b44f74b6-043a-4948-961d-479eb18a6d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:25.670216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f74b6-043a-4948-961d-479eb18a6d07 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:25.675811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:25.678284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:25.678577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:25.679278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] PATH_INFO: `/v3/users/3cfe4a71879849b581eb8b48b24107fd` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:25.680746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfe4a71879849b581eb8b48b24107fd)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:25.682686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:25.757520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfe4a71879849b581eb8b48b24107fd'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:25.776858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfe4a71879849b581eb8b48b24107fd'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:25.798750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfe4a71879849b581eb8b48b24107fd'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:25.806812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfe4a71879849b581eb8b48b24107fd'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:25.807524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-63d696b9-9a10-4e6c-8ec3-fb76256525d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfe4a71879849b581eb8b48b24107fd'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:25.813725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1107/2209] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:25 2022] DELETE /identity/v3/users/3cfe4a71879849b581eb8b48b24107fd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:25.993719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99183da3-f84a-4dfc-a615-05951eda5cb1 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:26.025686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99183da3-f84a-4dfc-a615-05951eda5cb1 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:26.082321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:26.083918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.084204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.084485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] PATH_INFO: `/v3/projects/598ee83f7e1a494c8b94f241ab626b65` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.085729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] RBAC: Authorizing `identity:delete_project(project_id=598ee83f7e1a494c8b94f241ab626b65)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:26.087689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:26.168065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598ee83f7e1a494c8b94f241ab626b65', 'request_id': 'req-3e401226-b7fd-4f76-85d9-22b35cad835d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:26.180017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598ee83f7e1a494c8b94f241ab626b65', 'request_id': 'req-3e401226-b7fd-4f76-85d9-22b35cad835d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:26.189592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598ee83f7e1a494c8b94f241ab626b65', 'request_id': 'req-3e401226-b7fd-4f76-85d9-22b35cad835d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:26.201852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] The token cache is being invalidate because project 598ee83f7e1a494c8b94f241ab626b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:26.202383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:26.203435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3e401226-b7fd-4f76-85d9-22b35cad835d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:26.205537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1103/2210] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:25 2022] DELETE /identity/v3/projects/598ee83f7e1a494c8b94f241ab626b65 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:26.213385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81171b7c-ff41-4c6a-ba3a-e71033826e7c None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.213673 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81171b7c-ff41-4c6a-ba3a-e71033826e7c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.213948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81171b7c-ff41-4c6a-ba3a-e71033826e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.265850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-81171b7c-ff41-4c6a-ba3a-e71033826e7c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:26.267081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-81171b7c-ff41-4c6a-ba3a-e71033826e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:26.334552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1108/2211] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:26.342496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc3f4a-37ca-40c2-817c-22dba8ca3ade None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.342788 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc3f4a-37ca-40c2-817c-22dba8ca3ade None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.343072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc3f4a-37ca-40c2-817c-22dba8ca3ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.369588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-01dc3f4a-37ca-40c2-817c-22dba8ca3ade None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:26.370807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-01dc3f4a-37ca-40c2-817c-22dba8ca3ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:26.379232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1104/2212] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:26.383704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81171b7c-ff41-4c6a-ba3a-e71033826e7c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:26.394059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81171b7c-ff41-4c6a-ba3a-e71033826e7c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:26.399663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c8d51-bb36-49f3-a3f3-f417009f2176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:26.400363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8d51-bb36-49f3-a3f3-f417009f2176 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.400650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8d51-bb36-49f3-a3f3-f417009f2176 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.400946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c8d51-bb36-49f3-a3f3-f417009f2176 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.401754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8d51-bb36-49f3-a3f3-f417009f2176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:51:26.402073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8d51-bb36-49f3-a3f3-f417009f2176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:26.403694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c8d51-bb36-49f3-a3f3-f417009f2176 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:26.417056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1109/2213] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:51:26.421220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc3f4a-37ca-40c2-817c-22dba8ca3ade None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:26.430263 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc3f4a-37ca-40c2-817c-22dba8ca3ade None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:26.435023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c5672-c15a-48a5-ae83-daadc177e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:26.435809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c5672-c15a-48a5-ae83-daadc177e95f admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.436100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c5672-c15a-48a5-ae83-daadc177e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.436383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c5672-c15a-48a5-ae83-daadc177e95f admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.437112 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c5672-c15a-48a5-ae83-daadc177e95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:26.439056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c5672-c15a-48a5-ae83-daadc177e95f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:26.466516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1105/2214] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:26 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:26.470685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c8d51-bb36-49f3-a3f3-f417009f2176 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:26.481502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c8d51-bb36-49f3-a3f3-f417009f2176 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:26.546914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c952dc-41fc-4584-a2ac-4ec43023af27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:26.547589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c952dc-41fc-4584-a2ac-4ec43023af27 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.547876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c952dc-41fc-4584-a2ac-4ec43023af27 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.548164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c952dc-41fc-4584-a2ac-4ec43023af27 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.549130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c952dc-41fc-4584-a2ac-4ec43023af27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:26.551171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c952dc-41fc-4584-a2ac-4ec43023af27 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:26.572779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1110/2215] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:26 2022] POST /identity/v3/users => generated 304 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:51:26.576959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c5672-c15a-48a5-ae83-daadc177e95f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:26.587904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c5672-c15a-48a5-ae83-daadc177e95f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:26.594075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef81f1-f06e-4179-8893-827ec4f5dacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:26.595048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef81f1-f06e-4179-8893-827ec4f5dacc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.595514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef81f1-f06e-4179-8893-827ec4f5dacc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.595818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef81f1-f06e-4179-8893-827ec4f5dacc admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.596556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef81f1-f06e-4179-8893-827ec4f5dacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:26.598692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef81f1-f06e-4179-8893-827ec4f5dacc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:26.609823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1106/2216] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:26.614254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c952dc-41fc-4584-a2ac-4ec43023af27 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:26.625118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c952dc-41fc-4584-a2ac-4ec43023af27 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:26.634327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628e654-4a06-4137-aa6b-35f750df27fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:26.635011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628e654-4a06-4137-aa6b-35f750df27fe admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.640641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628e654-4a06-4137-aa6b-35f750df27fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.641056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628e654-4a06-4137-aa6b-35f750df27fe admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.641856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628e654-4a06-4137-aa6b-35f750df27fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:26.643527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628e654-4a06-4137-aa6b-35f750df27fe admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:26.660040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1111/2217] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:26.664572 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef81f1-f06e-4179-8893-827ec4f5dacc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:26.679075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef81f1-f06e-4179-8893-827ec4f5dacc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:26.684332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc274-6cb4-4042-ba39-e74852239f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:26.685292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc274-6cb4-4042-ba39-e74852239f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.685643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc274-6cb4-4042-ba39-e74852239f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.685984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc274-6cb4-4042-ba39-e74852239f09 admin admin] PATH_INFO: `/v3/projects/749c1d737a92411683ab7e862aaa15ee/users/bd20728fdee44303ba73a97fec0db647/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.706907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc274-6cb4-4042-ba39-e74852239f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=749c1d737a92411683ab7e862aaa15ee, user_id=bd20728fdee44303ba73a97fec0db647, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:26.710869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc274-6cb4-4042-ba39-e74852239f09 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:26.729469 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1107/2218] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:26 2022] PUT /identity/v3/projects/749c1d737a92411683ab7e862aaa15ee/users/bd20728fdee44303ba73a97fec0db647/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:26.740083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f3df1-5efa-4d75-977c-8d37ed5ed605 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.740376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f3df1-5efa-4d75-977c-8d37ed5ed605 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.740832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f3df1-5efa-4d75-977c-8d37ed5ed605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.771529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2a9f3df1-5efa-4d75-977c-8d37ed5ed605 None None] MFA Rules not processed for user `bd20728fdee44303ba73a97fec0db647`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:26.773002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2a9f3df1-5efa-4d75-977c-8d37ed5ed605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:26.842864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1112/2219] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:26.846967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc274-6cb4-4042-ba39-e74852239f09 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:26.910910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc274-6cb4-4042-ba39-e74852239f09 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:26.920288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18b51f-c300-4d30-9a2e-b3d9e3056954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:26.920982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18b51f-c300-4d30-9a2e-b3d9e3056954 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:26.921250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18b51f-c300-4d30-9a2e-b3d9e3056954 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:26.921557 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18b51f-c300-4d30-9a2e-b3d9e3056954 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:26.922889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18b51f-c300-4d30-9a2e-b3d9e3056954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:26.926023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18b51f-c300-4d30-9a2e-b3d9e3056954 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:26.971538 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1108/2220] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:26 2022] POST /identity/v3/projects => generated 409 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:26.976640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f3df1-5efa-4d75-977c-8d37ed5ed605 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:26.990313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9f3df1-5efa-4d75-977c-8d37ed5ed605 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:27.060865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ad6b8-ca43-402b-96df-f47b336b7b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:27.062762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad6b8-ca43-402b-96df-f47b336b7b6f admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:27.063273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad6b8-ca43-402b-96df-f47b336b7b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:27.063980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ad6b8-ca43-402b-96df-f47b336b7b6f admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:27.065018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ad6b8-ca43-402b-96df-f47b336b7b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:27.068543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1ad6b8-ca43-402b-96df-f47b336b7b6f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:27.097410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1113/2221] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:26 2022] POST /identity/v3/users => generated 311 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:27.098935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18b51f-c300-4d30-9a2e-b3d9e3056954 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:27.112243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18b51f-c300-4d30-9a2e-b3d9e3056954 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:27.117682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed2539-e90d-49ef-bcfd-27548941a9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:27.118433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed2539-e90d-49ef-bcfd-27548941a9cb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:27.118791 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed2539-e90d-49ef-bcfd-27548941a9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:27.119160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed2539-e90d-49ef-bcfd-27548941a9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:27.120110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed2539-e90d-49ef-bcfd-27548941a9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:27.121738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed2539-e90d-49ef-bcfd-27548941a9cb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:27.136317 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1109/2222] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:51:27.140602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ad6b8-ca43-402b-96df-f47b336b7b6f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:27.153214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ad6b8-ca43-402b-96df-f47b336b7b6f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:27.168885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0c614-3caf-4000-8186-687bd70bea5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:27.169812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0c614-3caf-4000-8186-687bd70bea5c admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:27.170092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0c614-3caf-4000-8186-687bd70bea5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:27.170374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0c614-3caf-4000-8186-687bd70bea5c admin admin] PATH_INFO: `/v3/projects/5bc049c6ab834442ba860da4ada3cf20/users/f3bf6fdd1d9d45a3a9affbd2be8992c2/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:27.188636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0c614-3caf-4000-8186-687bd70bea5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc049c6ab834442ba860da4ada3cf20, user_id=f3bf6fdd1d9d45a3a9affbd2be8992c2, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:27.191405 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0c614-3caf-4000-8186-687bd70bea5c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:27.212344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1114/2223] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:27 2022] PUT /identity/v3/projects/5bc049c6ab834442ba860da4ada3cf20/users/f3bf6fdd1d9d45a3a9affbd2be8992c2/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:27.216215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed2539-e90d-49ef-bcfd-27548941a9cb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:27.226888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed2539-e90d-49ef-bcfd-27548941a9cb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:27.297567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8cfa9-aebc-4ad9-9946-c47d73003060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:27.298319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8cfa9-aebc-4ad9-9946-c47d73003060 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:27.298610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8cfa9-aebc-4ad9-9946-c47d73003060 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:27.298895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8cfa9-aebc-4ad9-9946-c47d73003060 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:27.299681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8cfa9-aebc-4ad9-9946-c47d73003060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:27.302090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8cfa9-aebc-4ad9-9946-c47d73003060 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:27.315610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1110/2224] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:27.318839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0c614-3caf-4000-8186-687bd70bea5c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:27.335241 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0c614-3caf-4000-8186-687bd70bea5c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:27.342223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6158-3816-49c3-95c2-3b9d2b8366e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:27.343127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6158-3816-49c3-95c2-3b9d2b8366e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:27.343765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6158-3816-49c3-95c2-3b9d2b8366e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:27.343765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a6158-3816-49c3-95c2-3b9d2b8366e9 admin admin] PATH_INFO: `/v3/projects/5bc049c6ab834442ba860da4ada3cf20/users/f3bf6fdd1d9d45a3a9affbd2be8992c2/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:27.346565 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a6158-3816-49c3-95c2-3b9d2b8366e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc049c6ab834442ba860da4ada3cf20, user_id=f3bf6fdd1d9d45a3a9affbd2be8992c2, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:27.350537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a6158-3816-49c3-95c2-3b9d2b8366e9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:27.365360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1115/2225] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:27 2022] PUT /identity/v3/projects/5bc049c6ab834442ba860da4ada3cf20/users/f3bf6fdd1d9d45a3a9affbd2be8992c2/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:27.376652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6f023-09e7-4a9b-beca-e195d51a3c30 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:27.376950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6f023-09e7-4a9b-beca-e195d51a3c30 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:27.377230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6f023-09e7-4a9b-beca-e195d51a3c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:27.405977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-f9c6f023-09e7-4a9b-beca-e195d51a3c30 None None] MFA Rules not processed for user `f3bf6fdd1d9d45a3a9affbd2be8992c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:27.407193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f9c6f023-09e7-4a9b-beca-e195d51a3c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:27.474310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1111/2226] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:27.483960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6158-3816-49c3-95c2-3b9d2b8366e9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:27.485663 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-bc9a6158-3816-49c3-95c2-3b9d2b8366e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:27.567203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a6158-3816-49c3-95c2-3b9d2b8366e9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:27.571027 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c20fc-ce28-4800-b701-e136d9561587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:27.571709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c20fc-ce28-4800-b701-e136d9561587 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:27.571997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c20fc-ce28-4800-b701-e136d9561587 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:27.572312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c20fc-ce28-4800-b701-e136d9561587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:27.588870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c20fc-ce28-4800-b701-e136d9561587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:27.590396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c20fc-ce28-4800-b701-e136d9561587 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:27.601935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1116/2227] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:27.784199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6f023-09e7-4a9b-beca-e195d51a3c30 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:27.796747 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6f023-09e7-4a9b-beca-e195d51a3c30 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:27.803763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78025322-d766-4090-80a5-685b593c01bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:27.804890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025322-d766-4090-80a5-685b593c01bd service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:27.805405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025322-d766-4090-80a5-685b593c01bd service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:27.805711 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78025322-d766-4090-80a5-685b593c01bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:27.869869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78025322-d766-4090-80a5-685b593c01bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:27.871571 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78025322-d766-4090-80a5-685b593c01bd service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:27.882589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1112/2228] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:36.392725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c20fc-ce28-4800-b701-e136d9561587 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:36.454943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c20fc-ce28-4800-b701-e136d9561587 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:36.459543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:36.460429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:36.460712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:36.460989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] PATH_INFO: `/v3/users/bd20728fdee44303ba73a97fec0db647` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:36.462301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd20728fdee44303ba73a97fec0db647)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:36.464254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:36.517521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd20728fdee44303ba73a97fec0db647'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:36.525711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd20728fdee44303ba73a97fec0db647'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:36.539596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd20728fdee44303ba73a97fec0db647'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:36.551228 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd20728fdee44303ba73a97fec0db647'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:36.553793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd20728fdee44303ba73a97fec0db647'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:36.561138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1117/2229] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:36 2022] DELETE /identity/v3/users/bd20728fdee44303ba73a97fec0db647 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:36.565620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35db27-f7aa-4867-a230-d836b081b6d1 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:36.566605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35db27-f7aa-4867-a230-d836b081b6d1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:36.567173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35db27-f7aa-4867-a230-d836b081b6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:36.585905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-3d35db27-f7aa-4867-a230-d836b081b6d1 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:36.587160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3d35db27-f7aa-4867-a230-d836b081b6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:36.658173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1113/2230] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:51:36.676600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:36.687830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:36.797484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90039376-f9f3-491e-8617-e4a248319495 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:36.801966 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fc772-ab9e-4d5b-986a-5348c3d7d503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:36.802651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc772-ab9e-4d5b-986a-5348c3d7d503 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:36.803101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc772-ab9e-4d5b-986a-5348c3d7d503 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:36.803385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fc772-ab9e-4d5b-986a-5348c3d7d503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:36.814685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fc772-ab9e-4d5b-986a-5348c3d7d503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:36.817902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fc772-ab9e-4d5b-986a-5348c3d7d503 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:36.852385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1118/2231] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:36.953968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73346389-3422-46c2-8181-2b551c423411 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:36.954693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73346389-3422-46c2-8181-2b551c423411 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:36.955136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73346389-3422-46c2-8181-2b551c423411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:37.000642 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-73346389-3422-46c2-8181-2b551c423411 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:37.002213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-73346389-3422-46c2-8181-2b551c423411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:37.068194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1114/2232] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:37.124468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fc772-ab9e-4d5b-986a-5348c3d7d503 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:37.126280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a04fc772-ab9e-4d5b-986a-5348c3d7d503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:37.185745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73346389-3422-46c2-8181-2b551c423411 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:37.187282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-73346389-3422-46c2-8181-2b551c423411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:37.202101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fc772-ab9e-4d5b-986a-5348c3d7d503 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:37.202818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73346389-3422-46c2-8181-2b551c423411 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:37.208148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8f8e9-5c51-45b0-ab7d-5869db7c074c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:37.208296 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:37.208837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f8e9-5c51-45b0-ab7d-5869db7c074c service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:37.209030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:37.209158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f8e9-5c51-45b0-ab7d-5869db7c074c service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:37.209308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:37.209444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa8f8e9-5c51-45b0-ab7d-5869db7c074c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:37.209859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] PATH_INFO: `/v3/projects/749c1d737a92411683ab7e862aaa15ee` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:37.211202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=749c1d737a92411683ab7e862aaa15ee)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:37.213286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:37.219516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f8e9-5c51-45b0-ab7d-5869db7c074c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:37.221130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa8f8e9-5c51-45b0-ab7d-5869db7c074c service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:37.230064 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1119/2233] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:51:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:51:37.270721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '749c1d737a92411683ab7e862aaa15ee', 'request_id': 'req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.281416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '749c1d737a92411683ab7e862aaa15ee', 'request_id': 'req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.289126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '749c1d737a92411683ab7e862aaa15ee', 'request_id': 'req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.299692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] The token cache is being invalidate because project 749c1d737a92411683ab7e862aaa15ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:37.300113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.301090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.302854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1115/2234] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:37 2022] DELETE /identity/v3/projects/749c1d737a92411683ab7e862aaa15ee => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:37.307048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8f8e9-5c51-45b0-ab7d-5869db7c074c service swift] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:37.319197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa8f8e9-5c51-45b0-ab7d-5869db7c074c service swift] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:37.388173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:37.389712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:37.389930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:37.390381 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] PATH_INFO: `/v3/users/f3bf6fdd1d9d45a3a9affbd2be8992c2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:37.392267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bf6fdd1d9d45a3a9affbd2be8992c2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:37.395312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:37.464334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bf6fdd1d9d45a3a9affbd2be8992c2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.475623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bf6fdd1d9d45a3a9affbd2be8992c2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.509354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bf6fdd1d9d45a3a9affbd2be8992c2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.523180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bf6fdd1d9d45a3a9affbd2be8992c2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.524229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-819e117e-f628-4305-a9e6-0ea2bff16025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bf6fdd1d9d45a3a9affbd2be8992c2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:37.532336 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1120/2235] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:37 2022] DELETE /identity/v3/users/f3bf6fdd1d9d45a3a9affbd2be8992c2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:37.948952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:37.951076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:37.974855 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2314f1b-04b6-43e3-9e92-2bbbd2cebf5a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:38.078241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:38.079696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:38.080401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:38.080844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] PATH_INFO: `/v3/projects/5bc049c6ab834442ba860da4ada3cf20` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:38.083264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc049c6ab834442ba860da4ada3cf20)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:38.086898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:38.177529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc049c6ab834442ba860da4ada3cf20', 'request_id': 'req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:38.191281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc049c6ab834442ba860da4ada3cf20', 'request_id': 'req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:38.204588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc049c6ab834442ba860da4ada3cf20', 'request_id': 'req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:38.224231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] The token cache is being invalidate because project 5bc049c6ab834442ba860da4ada3cf20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:38.224729 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:38.225561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ab9fa9ca-927b-41c3-8ebd-e90fda1d260a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:38.227289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1116/2236] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:37 2022] DELETE /identity/v3/projects/5bc049c6ab834442ba860da4ada3cf20 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:38.233140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a354bf2-1e92-44c9-9fff-95ebdb34b27b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:38.233968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a354bf2-1e92-44c9-9fff-95ebdb34b27b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:38.234544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a354bf2-1e92-44c9-9fff-95ebdb34b27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:38.271790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-4a354bf2-1e92-44c9-9fff-95ebdb34b27b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:38.273745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4a354bf2-1e92-44c9-9fff-95ebdb34b27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:38.391403 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1121/2237] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:51:38.399769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487186-a380-4a18-a5f0-cfec0fb82281 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:38.400052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487186-a380-4a18-a5f0-cfec0fb82281 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:38.400562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487186-a380-4a18-a5f0-cfec0fb82281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:38.444466 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-da487186-a380-4a18-a5f0-cfec0fb82281 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:38.445808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-da487186-a380-4a18-a5f0-cfec0fb82281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:38.463743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1117/2238] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:38.476611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a354bf2-1e92-44c9-9fff-95ebdb34b27b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:38.489078 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a354bf2-1e92-44c9-9fff-95ebdb34b27b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:38.496968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725f54-814b-40f5-b334-64bda602971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:38.498009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725f54-814b-40f5-b334-64bda602971c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:38.499266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725f54-814b-40f5-b334-64bda602971c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:38.499777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9725f54-814b-40f5-b334-64bda602971c admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:38.500853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9725f54-814b-40f5-b334-64bda602971c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:51:38.501333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9725f54-814b-40f5-b334-64bda602971c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:38.503911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9725f54-814b-40f5-b334-64bda602971c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:38.518180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1122/2239] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:51:38.524218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da487186-a380-4a18-a5f0-cfec0fb82281 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:38.534258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da487186-a380-4a18-a5f0-cfec0fb82281 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:38.546784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92482b59-2249-4c74-b04a-058bb04ee976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:38.547654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92482b59-2249-4c74-b04a-058bb04ee976 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:38.547789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92482b59-2249-4c74-b04a-058bb04ee976 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:38.548225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92482b59-2249-4c74-b04a-058bb04ee976 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:38.549045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92482b59-2249-4c74-b04a-058bb04ee976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:38.551925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92482b59-2249-4c74-b04a-058bb04ee976 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:38.591604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1118/2240] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:38 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:38.592734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725f54-814b-40f5-b334-64bda602971c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:38.603545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9725f54-814b-40f5-b334-64bda602971c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:38.726069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18a023-237b-464f-af6b-d3afcb67850e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:38.726815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18a023-237b-464f-af6b-d3afcb67850e admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:38.727035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18a023-237b-464f-af6b-d3afcb67850e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:38.727313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18a023-237b-464f-af6b-d3afcb67850e admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:38.728058 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18a023-237b-464f-af6b-d3afcb67850e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:38.736396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18a023-237b-464f-af6b-d3afcb67850e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:38.777651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1123/2241] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:38 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:38.780041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92482b59-2249-4c74-b04a-058bb04ee976 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:38.795030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92482b59-2249-4c74-b04a-058bb04ee976 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:38.831983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271215b4-68c2-46dd-ad62-30e4851264cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:38.833359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271215b4-68c2-46dd-ad62-30e4851264cb admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:38.833869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271215b4-68c2-46dd-ad62-30e4851264cb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:38.834357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271215b4-68c2-46dd-ad62-30e4851264cb admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:38.835340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271215b4-68c2-46dd-ad62-30e4851264cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:38.837414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271215b4-68c2-46dd-ad62-30e4851264cb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:38.871885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1119/2242] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:38.872820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18a023-237b-464f-af6b-d3afcb67850e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:38.891612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18a023-237b-464f-af6b-d3afcb67850e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:38.897891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65f1d4-3453-4ec6-8934-be523861af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:38.898566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65f1d4-3453-4ec6-8934-be523861af20 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:38.898847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65f1d4-3453-4ec6-8934-be523861af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:38.899384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65f1d4-3453-4ec6-8934-be523861af20 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:38.900185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65f1d4-3453-4ec6-8934-be523861af20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:38.902066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65f1d4-3453-4ec6-8934-be523861af20 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:38.922663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271215b4-68c2-46dd-ad62-30e4851264cb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:38.929828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1124/2243] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:38.936167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271215b4-68c2-46dd-ad62-30e4851264cb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:38.948850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a523-2c09-4705-b963-f6134cd9cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:38.949799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a523-2c09-4705-b963-f6134cd9cf5a admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:38.950455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a523-2c09-4705-b963-f6134cd9cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:38.950455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009a523-2c09-4705-b963-f6134cd9cf5a admin admin] PATH_INFO: `/v3/projects/1ea96881c36d4fd2a747bff1d96cce5d/users/6115b2c7af474aabaabfb624ff7684a4/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:38.970353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009a523-2c09-4705-b963-f6134cd9cf5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ea96881c36d4fd2a747bff1d96cce5d, user_id=6115b2c7af474aabaabfb624ff7684a4, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:38.973477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009a523-2c09-4705-b963-f6134cd9cf5a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:38.999507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1120/2244] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:38 2022] PUT /identity/v3/projects/1ea96881c36d4fd2a747bff1d96cce5d/users/6115b2c7af474aabaabfb624ff7684a4/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:39.002374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921d4a-8a14-4dad-a8e8-e7ec2725735a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:39.002671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921d4a-8a14-4dad-a8e8-e7ec2725735a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:39.002951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921d4a-8a14-4dad-a8e8-e7ec2725735a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:39.038334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b5921d4a-8a14-4dad-a8e8-e7ec2725735a None None] MFA Rules not processed for user `6115b2c7af474aabaabfb624ff7684a4`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:39.039859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b5921d4a-8a14-4dad-a8e8-e7ec2725735a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:39.139330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1125/2245] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:39.145047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a523-2c09-4705-b963-f6134cd9cf5a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:39.234460 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009a523-2c09-4705-b963-f6134cd9cf5a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:39.240162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22201c03-f15c-4eeb-967a-2b68133d86c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:39.240822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22201c03-f15c-4eeb-967a-2b68133d86c7 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:39.241295 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22201c03-f15c-4eeb-967a-2b68133d86c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:39.241740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22201c03-f15c-4eeb-967a-2b68133d86c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:39.242610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22201c03-f15c-4eeb-967a-2b68133d86c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:39.244537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22201c03-f15c-4eeb-967a-2b68133d86c7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:39.281408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5921d4a-8a14-4dad-a8e8-e7ec2725735a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:39.283309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1121/2246] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:39 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:39.293431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5921d4a-8a14-4dad-a8e8-e7ec2725735a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:39.362580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615cda5-9f0f-4726-8759-eb351b598962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:39.363928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615cda5-9f0f-4726-8759-eb351b598962 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:39.364376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615cda5-9f0f-4726-8759-eb351b598962 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:39.364686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615cda5-9f0f-4726-8759-eb351b598962 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:39.365598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615cda5-9f0f-4726-8759-eb351b598962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:39.367540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615cda5-9f0f-4726-8759-eb351b598962 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:39.397295 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1126/2247] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:39 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:39.399539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22201c03-f15c-4eeb-967a-2b68133d86c7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:39.413456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22201c03-f15c-4eeb-967a-2b68133d86c7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:39.432167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb4c15-29fa-40f7-8773-8a8dffce6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:39.433160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb4c15-29fa-40f7-8773-8a8dffce6625 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:39.433618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb4c15-29fa-40f7-8773-8a8dffce6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:39.433900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb4c15-29fa-40f7-8773-8a8dffce6625 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:39.434655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb4c15-29fa-40f7-8773-8a8dffce6625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:39.436296 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb4c15-29fa-40f7-8773-8a8dffce6625 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:39.459591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1122/2248] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:39.462946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615cda5-9f0f-4726-8759-eb351b598962 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:39.478460 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615cda5-9f0f-4726-8759-eb351b598962 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:39.491121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6549bbb-9bb6-491c-b025-347bea623523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:39.495468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6549bbb-9bb6-491c-b025-347bea623523 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:39.496668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6549bbb-9bb6-491c-b025-347bea623523 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:39.497233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6549bbb-9bb6-491c-b025-347bea623523 admin admin] PATH_INFO: `/v3/projects/0b94f622c8f74fd0a7ede91dd188b9a8/users/a4fe7f09ffd6479396c316906e8235e1/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:39.520722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6549bbb-9bb6-491c-b025-347bea623523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b94f622c8f74fd0a7ede91dd188b9a8, user_id=a4fe7f09ffd6479396c316906e8235e1, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:39.523853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6549bbb-9bb6-491c-b025-347bea623523 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:39.559755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1127/2249] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:39 2022] PUT /identity/v3/projects/0b94f622c8f74fd0a7ede91dd188b9a8/users/a4fe7f09ffd6479396c316906e8235e1/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:39.563967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb4c15-29fa-40f7-8773-8a8dffce6625 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:39.575863 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb4c15-29fa-40f7-8773-8a8dffce6625 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:39.647451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7f39c-e296-4302-aab4-e8ef0f91be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:39.648302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f39c-e296-4302-aab4-e8ef0f91be3b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:39.648687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f39c-e296-4302-aab4-e8ef0f91be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:39.649068 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7f39c-e296-4302-aab4-e8ef0f91be3b admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:39.649960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7f39c-e296-4302-aab4-e8ef0f91be3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:39.651941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7f39c-e296-4302-aab4-e8ef0f91be3b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:39.667622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1123/2250] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:39.669238 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6549bbb-9bb6-491c-b025-347bea623523 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:39.681781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6549bbb-9bb6-491c-b025-347bea623523 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:39.686763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4205a45-d748-4f00-8588-030b95f818fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:39.687702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4205a45-d748-4f00-8588-030b95f818fa admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:39.687990 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4205a45-d748-4f00-8588-030b95f818fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:39.688272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4205a45-d748-4f00-8588-030b95f818fa admin admin] PATH_INFO: `/v3/projects/0b94f622c8f74fd0a7ede91dd188b9a8/users/a4fe7f09ffd6479396c316906e8235e1/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:39.690525 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4205a45-d748-4f00-8588-030b95f818fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b94f622c8f74fd0a7ede91dd188b9a8, user_id=a4fe7f09ffd6479396c316906e8235e1, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:39.693838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4205a45-d748-4f00-8588-030b95f818fa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:39.706438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1128/2251] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:39 2022] PUT /identity/v3/projects/0b94f622c8f74fd0a7ede91dd188b9a8/users/a4fe7f09ffd6479396c316906e8235e1/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:39.718703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1fa4-ea9d-4b79-b01b-a70b946a9bea None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:39.718991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1fa4-ea9d-4b79-b01b-a70b946a9bea None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:39.719272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e1fa4-ea9d-4b79-b01b-a70b946a9bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:39.755977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-5e1e1fa4-ea9d-4b79-b01b-a70b946a9bea None None] MFA Rules not processed for user `a4fe7f09ffd6479396c316906e8235e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:39.757186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5e1e1fa4-ea9d-4b79-b01b-a70b946a9bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:39.835772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1124/2252] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:39.845991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4205a45-d748-4f00-8588-030b95f818fa admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:39.849214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b4205a45-d748-4f00-8588-030b95f818fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:39.962491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4205a45-d748-4f00-8588-030b95f818fa admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:39.980171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f335cf8-d49c-4625-9009-163fdd8392db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:39.980977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f335cf8-d49c-4625-9009-163fdd8392db service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:39.981274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f335cf8-d49c-4625-9009-163fdd8392db service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:39.981765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f335cf8-d49c-4625-9009-163fdd8392db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:39.993540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f335cf8-d49c-4625-9009-163fdd8392db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:39.995007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f335cf8-d49c-4625-9009-163fdd8392db service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:40.006999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1129/2253] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:40.719175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e1fa4-ea9d-4b79-b01b-a70b946a9bea None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:40.859070 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e1fa4-ea9d-4b79-b01b-a70b946a9bea None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:40.864719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:40.865686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:40.865967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:40.866243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] PATH_INFO: `/v3/users/6115b2c7af474aabaabfb624ff7684a4` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:40.867453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6115b2c7af474aabaabfb624ff7684a4)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:40.869537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:40.961749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6115b2c7af474aabaabfb624ff7684a4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:40.969965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6115b2c7af474aabaabfb624ff7684a4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:40.970728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6115b2c7af474aabaabfb624ff7684a4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:40.986065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6115b2c7af474aabaabfb624ff7684a4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:41.001995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6115b2c7af474aabaabfb624ff7684a4'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:41.012795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1125/2254] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:40 2022] DELETE /identity/v3/users/6115b2c7af474aabaabfb624ff7684a4 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:41.022160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c6493-5134-4072-a358-ff978b2ffbb8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:41.023290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c6493-5134-4072-a358-ff978b2ffbb8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:41.023290 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c6493-5134-4072-a358-ff978b2ffbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:41.068696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-401c6493-5134-4072-a358-ff978b2ffbb8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:41.069915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-401c6493-5134-4072-a358-ff978b2ffbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:41.142010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1130/2255] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:41.153608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:41.155077 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:41.227496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f592d6-a9c6-4c1f-9a80-eebea2a4ef7c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:41.238656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f762-117a-47ba-b8a3-a8f6b5d3455f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:41.240184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f762-117a-47ba-b8a3-a8f6b5d3455f service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:41.240710 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f762-117a-47ba-b8a3-a8f6b5d3455f service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:41.241226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f762-117a-47ba-b8a3-a8f6b5d3455f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:41.251995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f762-117a-47ba-b8a3-a8f6b5d3455f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:41.254239 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f762-117a-47ba-b8a3-a8f6b5d3455f service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:41.275060 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1126/2256] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:41.664388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c6493-5134-4072-a358-ff978b2ffbb8 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:41.665449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-401c6493-5134-4072-a358-ff978b2ffbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:41.686302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c6493-5134-4072-a358-ff978b2ffbb8 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:41.692280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:41.693177 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:41.693460 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:41.693739 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] PATH_INFO: `/v3/projects/1ea96881c36d4fd2a747bff1d96cce5d` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:41.695770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ea96881c36d4fd2a747bff1d96cce5d)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:41.708101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:41.782208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ea96881c36d4fd2a747bff1d96cce5d', 'request_id': 'req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:41.791557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ea96881c36d4fd2a747bff1d96cce5d', 'request_id': 'req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:41.797247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ea96881c36d4fd2a747bff1d96cce5d', 'request_id': 'req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:41.812645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] The token cache is being invalidate because project 1ea96881c36d4fd2a747bff1d96cce5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:41.813211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:41.814138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:41.819785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1131/2257] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:41 2022] DELETE /identity/v3/projects/1ea96881c36d4fd2a747bff1d96cce5d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:41.820826 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f762-117a-47ba-b8a3-a8f6b5d3455f service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:41.833285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f762-117a-47ba-b8a3-a8f6b5d3455f service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:41.937872 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:41.939007 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:41.939462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:41.939986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] PATH_INFO: `/v3/users/a4fe7f09ffd6479396c316906e8235e1` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:41.941933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4fe7f09ffd6479396c316906e8235e1)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:41.945089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:42.037943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4fe7f09ffd6479396c316906e8235e1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.055737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4fe7f09ffd6479396c316906e8235e1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.056665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4fe7f09ffd6479396c316906e8235e1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.094734 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4fe7f09ffd6479396c316906e8235e1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.110564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-206f780c-74e7-46c5-9d4b-869e5059ae35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4fe7f09ffd6479396c316906e8235e1'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.129172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1127/2258] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:41 2022] DELETE /identity/v3/users/a4fe7f09ffd6479396c316906e8235e1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:42.515667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:42.517802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:42.534307 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf90a5e-0019-47c7-8b25-5d65b65cdc06 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:42.614836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:42.615777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:42.616066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:42.616365 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] PATH_INFO: `/v3/projects/0b94f622c8f74fd0a7ede91dd188b9a8` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:42.617585 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b94f622c8f74fd0a7ede91dd188b9a8)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:42.619601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:42.673278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b94f622c8f74fd0a7ede91dd188b9a8', 'request_id': 'req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.681373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b94f622c8f74fd0a7ede91dd188b9a8', 'request_id': 'req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.689654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b94f622c8f74fd0a7ede91dd188b9a8', 'request_id': 'req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.705791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] The token cache is being invalidate because project 0b94f622c8f74fd0a7ede91dd188b9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:42.706089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.707595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-868908c1-85ce-4ccc-9c2a-791de2d2c4d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:42.709580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1132/2259] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:42 2022] DELETE /identity/v3/projects/0b94f622c8f74fd0a7ede91dd188b9a8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:42.716369 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959515-2e4d-460a-af3d-aad9790380c8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:42.716837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959515-2e4d-460a-af3d-aad9790380c8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:42.717235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08959515-2e4d-460a-af3d-aad9790380c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:42.744938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-08959515-2e4d-460a-af3d-aad9790380c8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:42.746664 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-08959515-2e4d-460a-af3d-aad9790380c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:42.867036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1128/2260] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:42.869575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf203af0-0863-476e-a1ee-c822b5381b7c None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:42.875181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf203af0-0863-476e-a1ee-c822b5381b7c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:42.875701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf203af0-0863-476e-a1ee-c822b5381b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:42.921971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-cf203af0-0863-476e-a1ee-c822b5381b7c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:42.923389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-cf203af0-0863-476e-a1ee-c822b5381b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:42.935618 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1133/2261] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:42.938667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08959515-2e4d-460a-af3d-aad9790380c8 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:42.958560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08959515-2e4d-460a-af3d-aad9790380c8 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:42.963957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0c2d-74ce-4bcb-bf33-efcd6736b687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:42.964645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0c2d-74ce-4bcb-bf33-efcd6736b687 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:42.964921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0c2d-74ce-4bcb-bf33-efcd6736b687 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:42.965201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db0c2d-74ce-4bcb-bf33-efcd6736b687 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:42.966009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db0c2d-74ce-4bcb-bf33-efcd6736b687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:51:42.966326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db0c2d-74ce-4bcb-bf33-efcd6736b687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:42.969065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db0c2d-74ce-4bcb-bf33-efcd6736b687 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.001895 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1129/2262] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:51:43.003967 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf203af0-0863-476e-a1ee-c822b5381b7c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.014371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf203af0-0863-476e-a1ee-c822b5381b7c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.022643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c68458-185e-421b-be4d-d6e697601e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.023321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c68458-185e-421b-be4d-d6e697601e4f admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.023641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c68458-185e-421b-be4d-d6e697601e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.023912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c68458-185e-421b-be4d-d6e697601e4f admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.024643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c68458-185e-421b-be4d-d6e697601e4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.026573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c68458-185e-421b-be4d-d6e697601e4f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.078959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1134/2263] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:43 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:51:43.080076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0c2d-74ce-4bcb-bf33-efcd6736b687 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.092304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db0c2d-74ce-4bcb-bf33-efcd6736b687 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.203062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59190-2776-412e-9b4e-bad197af56a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.204000 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59190-2776-412e-9b4e-bad197af56a8 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.204359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59190-2776-412e-9b4e-bad197af56a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.204710 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a59190-2776-412e-9b4e-bad197af56a8 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.205511 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59190-2776-412e-9b4e-bad197af56a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.207919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a59190-2776-412e-9b4e-bad197af56a8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.258257 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1130/2264] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:43 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:51:43.262145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c68458-185e-421b-be4d-d6e697601e4f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.274632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c68458-185e-421b-be4d-d6e697601e4f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.281176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb794f-dff1-40c2-9b32-e99eb701d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.281965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb794f-dff1-40c2-9b32-e99eb701d82d admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.282354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb794f-dff1-40c2-9b32-e99eb701d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.282736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb794f-dff1-40c2-9b32-e99eb701d82d admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.283635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb794f-dff1-40c2-9b32-e99eb701d82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.286179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb794f-dff1-40c2-9b32-e99eb701d82d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.306197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1135/2265] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:51:43.309992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59190-2776-412e-9b4e-bad197af56a8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.321785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a59190-2776-412e-9b4e-bad197af56a8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.326670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316d08a-fe79-49e8-ac35-b0c4c5270fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.327362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316d08a-fe79-49e8-ac35-b0c4c5270fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.327780 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316d08a-fe79-49e8-ac35-b0c4c5270fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.328068 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316d08a-fe79-49e8-ac35-b0c4c5270fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.328805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316d08a-fe79-49e8-ac35-b0c4c5270fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.330409 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316d08a-fe79-49e8-ac35-b0c4c5270fc6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.340856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1131/2266] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:43.345291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb794f-dff1-40c2-9b32-e99eb701d82d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.357727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb794f-dff1-40c2-9b32-e99eb701d82d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.362413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6779-ed84-4963-8655-509604411be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.364377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6779-ed84-4963-8655-509604411be2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.364662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6779-ed84-4963-8655-509604411be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.364945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6779-ed84-4963-8655-509604411be2 admin admin] PATH_INFO: `/v3/projects/92e06deb69be41a7b77cde807f831b01/users/08ac2b9598bc402a84b3b7e02db5276e/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.379919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6779-ed84-4963-8655-509604411be2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e06deb69be41a7b77cde807f831b01, user_id=08ac2b9598bc402a84b3b7e02db5276e, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.382601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6779-ed84-4963-8655-509604411be2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.400053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1136/2267] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:43 2022] PUT /identity/v3/projects/92e06deb69be41a7b77cde807f831b01/users/08ac2b9598bc402a84b3b7e02db5276e/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:43.411918 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85419d-e63f-42a7-a908-407102b0f1c6 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.412211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85419d-e63f-42a7-a908-407102b0f1c6 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.412493 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85419d-e63f-42a7-a908-407102b0f1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.440125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-8c85419d-e63f-42a7-a908-407102b0f1c6 None None] MFA Rules not processed for user `08ac2b9598bc402a84b3b7e02db5276e`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:43.441638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8c85419d-e63f-42a7-a908-407102b0f1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:43.514733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1132/2268] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:51:43.519059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6779-ed84-4963-8655-509604411be2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.585048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6779-ed84-4963-8655-509604411be2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.590431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4c7a6-b133-422e-b7b8-8f805a364cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.590651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c7a6-b133-422e-b7b8-8f805a364cde admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.590940 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c7a6-b133-422e-b7b8-8f805a364cde admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.591219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4c7a6-b133-422e-b7b8-8f805a364cde admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.591964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4c7a6-b133-422e-b7b8-8f805a364cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.594001 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4c7a6-b133-422e-b7b8-8f805a364cde admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.620714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1137/2269] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:43 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:43.624861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85419d-e63f-42a7-a908-407102b0f1c6 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.636454 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85419d-e63f-42a7-a908-407102b0f1c6 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.695556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b46668-8070-46f5-aa98-5226298b5bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.696285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b46668-8070-46f5-aa98-5226298b5bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.696553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b46668-8070-46f5-aa98-5226298b5bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.696831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b46668-8070-46f5-aa98-5226298b5bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.697559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b46668-8070-46f5-aa98-5226298b5bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.699501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b46668-8070-46f5-aa98-5226298b5bf9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.720814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1133/2270] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:43 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:51:43.725723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4c7a6-b133-422e-b7b8-8f805a364cde admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.737527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4c7a6-b133-422e-b7b8-8f805a364cde admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.744338 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2c9d0-6eef-4de1-bb8f-f73bd4c4e574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.745183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2c9d0-6eef-4de1-bb8f-f73bd4c4e574 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.745584 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2c9d0-6eef-4de1-bb8f-f73bd4c4e574 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.745907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2c9d0-6eef-4de1-bb8f-f73bd4c4e574 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.748267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2c9d0-6eef-4de1-bb8f-f73bd4c4e574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.750089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2c9d0-6eef-4de1-bb8f-f73bd4c4e574 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.762287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1138/2271] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:51:43.767220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b46668-8070-46f5-aa98-5226298b5bf9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.778956 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b46668-8070-46f5-aa98-5226298b5bf9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.785342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ee78-d561-4fc8-9033-2f2aff396120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.786484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ee78-d561-4fc8-9033-2f2aff396120 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.786821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ee78-d561-4fc8-9033-2f2aff396120 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.787105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55ee78-d561-4fc8-9033-2f2aff396120 admin admin] PATH_INFO: `/v3/projects/1c26eedf54234607a37d17faa2c9bfda/users/4b21f813eba943fb89f28face54dca57/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.806433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55ee78-d561-4fc8-9033-2f2aff396120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c26eedf54234607a37d17faa2c9bfda, user_id=4b21f813eba943fb89f28face54dca57, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.809961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55ee78-d561-4fc8-9033-2f2aff396120 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.831541 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1134/2272] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:43 2022] PUT /identity/v3/projects/1c26eedf54234607a37d17faa2c9bfda/users/4b21f813eba943fb89f28face54dca57/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:43.831768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeea6e-39b2-46c4-8a56-2308a6d9cbeb None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.831768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeea6e-39b2-46c4-8a56-2308a6d9cbeb None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.831768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeea6e-39b2-46c4-8a56-2308a6d9cbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.833141 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ee78-d561-4fc8-9033-2f2aff396120 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.860354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-38eeea6e-39b2-46c4-8a56-2308a6d9cbeb None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:43.861587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-38eeea6e-39b2-46c4-8a56-2308a6d9cbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:43.905157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55ee78-d561-4fc8-9033-2f2aff396120 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.911674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e57f8-4734-4d7d-a6d3-53b89127d985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.912718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e57f8-4734-4d7d-a6d3-53b89127d985 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.913063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e57f8-4734-4d7d-a6d3-53b89127d985 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.913485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e57f8-4734-4d7d-a6d3-53b89127d985 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.914889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e57f8-4734-4d7d-a6d3-53b89127d985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.916731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e57f8-4734-4d7d-a6d3-53b89127d985 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.931650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1135/2273] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:51:43.932281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1139/2274] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:51:43.934686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e57f8-4734-4d7d-a6d3-53b89127d985 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.947882 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eeea6e-39b2-46c4-8a56-2308a6d9cbeb None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:43.949253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-38eeea6e-39b2-46c4-8a56-2308a6d9cbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:43.949383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e57f8-4734-4d7d-a6d3-53b89127d985 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:43.954550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88306e34-9760-414b-a2b5-3c1f3028268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:43.955445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88306e34-9760-414b-a2b5-3c1f3028268b admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.955768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88306e34-9760-414b-a2b5-3c1f3028268b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.956051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88306e34-9760-414b-a2b5-3c1f3028268b admin admin] PATH_INFO: `/v3/projects/1c26eedf54234607a37d17faa2c9bfda/users/4b21f813eba943fb89f28face54dca57/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:43.958242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88306e34-9760-414b-a2b5-3c1f3028268b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c26eedf54234607a37d17faa2c9bfda, user_id=4b21f813eba943fb89f28face54dca57, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:43.961158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88306e34-9760-414b-a2b5-3c1f3028268b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:43.975607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1136/2275] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:43 2022] PUT /identity/v3/projects/1c26eedf54234607a37d17faa2c9bfda/users/4b21f813eba943fb89f28face54dca57/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:43.986185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f189-afa5-41bf-8071-3b890e4e1738 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:43.986716 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f189-afa5-41bf-8071-3b890e4e1738 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:43.989552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3f189-afa5-41bf-8071-3b890e4e1738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:44.058187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eeea6e-39b2-46c4-8a56-2308a6d9cbeb None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:44.059105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-dda3f189-afa5-41bf-8071-3b890e4e1738 None None] MFA Rules not processed for user `4b21f813eba943fb89f28face54dca57`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:44.060344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-dda3f189-afa5-41bf-8071-3b890e4e1738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:44.150580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1137/2276] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:44.167325 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f189-afa5-41bf-8071-3b890e4e1738 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:44.169911 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-dda3f189-afa5-41bf-8071-3b890e4e1738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:44.194431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8193-26b8-4693-9a79-19f33a11bc83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:44.198494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8193-26b8-4693-9a79-19f33a11bc83 service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:44.198494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8193-26b8-4693-9a79-19f33a11bc83 service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:44.198494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce8193-26b8-4693-9a79-19f33a11bc83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:44.268363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce8193-26b8-4693-9a79-19f33a11bc83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:44.270131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce8193-26b8-4693-9a79-19f33a11bc83 service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:44.280715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1140/2277] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:51:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:51:44.296526 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3f189-afa5-41bf-8071-3b890e4e1738 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:44.302055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a89470-8de0-42c3-9ce3-09fd43e81d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:44.302970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a89470-8de0-42c3-9ce3-09fd43e81d2c service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:44.303486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a89470-8de0-42c3-9ce3-09fd43e81d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:44.304020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a89470-8de0-42c3-9ce3-09fd43e81d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:44.342045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a89470-8de0-42c3-9ce3-09fd43e81d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:44.343951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a89470-8de0-42c3-9ce3-09fd43e81d2c service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:44.360262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1138/2278] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:45.129782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8193-26b8-4693-9a79-19f33a11bc83 service swift] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:45.256718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce8193-26b8-4693-9a79-19f33a11bc83 service swift] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:45.263605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:45.264737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:45.265123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:45.265606 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] PATH_INFO: `/v3/users/08ac2b9598bc402a84b3b7e02db5276e` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:45.267666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08ac2b9598bc402a84b3b7e02db5276e)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:45.270028 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:45.408827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08ac2b9598bc402a84b3b7e02db5276e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:45.428128 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08ac2b9598bc402a84b3b7e02db5276e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:45.462477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08ac2b9598bc402a84b3b7e02db5276e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:45.474744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08ac2b9598bc402a84b3b7e02db5276e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:45.475795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08ac2b9598bc402a84b3b7e02db5276e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:45.485560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1141/2279] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:45 2022] DELETE /identity/v3/users/08ac2b9598bc402a84b3b7e02db5276e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:45.492203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328146e-a449-4dcc-b524-3cbf59992319 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:45.493263 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328146e-a449-4dcc-b524-3cbf59992319 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:45.493824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328146e-a449-4dcc-b524-3cbf59992319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:45.536247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c328146e-a449-4dcc-b524-3cbf59992319 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:45.537658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c328146e-a449-4dcc-b524-3cbf59992319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:45.717471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1139/2280] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:45.728740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:45.730297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:45.939949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec84994-9b85-43f6-b278-657f37acb608 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:45.978203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183cace-5689-478b-b639-22b05396d711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:45.978203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183cace-5689-478b-b639-22b05396d711 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:45.978203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183cace-5689-478b-b639-22b05396d711 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:45.982204 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183cace-5689-478b-b639-22b05396d711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:46.009762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183cace-5689-478b-b639-22b05396d711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:46.013986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183cace-5689-478b-b639-22b05396d711 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:46.041230 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1142/2281] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:47.066941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328146e-a449-4dcc-b524-3cbf59992319 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:47.071861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c328146e-a449-4dcc-b524-3cbf59992319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:47.106046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328146e-a449-4dcc-b524-3cbf59992319 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:47.111989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:47.114651 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:47.115868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:47.117242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] PATH_INFO: `/v3/projects/92e06deb69be41a7b77cde807f831b01` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:47.125601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e06deb69be41a7b77cde807f831b01)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:47.128272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:47.277902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e06deb69be41a7b77cde807f831b01', 'request_id': 'req-3bd507ce-a196-48a7-9464-748ead4e1d1d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.295130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e06deb69be41a7b77cde807f831b01', 'request_id': 'req-3bd507ce-a196-48a7-9464-748ead4e1d1d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.302171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e06deb69be41a7b77cde807f831b01', 'request_id': 'req-3bd507ce-a196-48a7-9464-748ead4e1d1d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.320096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] The token cache is being invalidate because project 92e06deb69be41a7b77cde807f831b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:47.320478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.321267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.325974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1140/2282] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:47 2022] DELETE /identity/v3/projects/92e06deb69be41a7b77cde807f831b01 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:47.328478 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183cace-5689-478b-b639-22b05396d711 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:47.344146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183cace-5689-478b-b639-22b05396d711 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:47.424457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:47.425949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:47.426343 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:47.426767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] PATH_INFO: `/v3/users/4b21f813eba943fb89f28face54dca57` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:47.428210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b21f813eba943fb89f28face54dca57)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:47.430274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:47.509121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b21f813eba943fb89f28face54dca57'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.529684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b21f813eba943fb89f28face54dca57'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.594153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b21f813eba943fb89f28face54dca57'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.606611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b21f813eba943fb89f28face54dca57'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.607275 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-1bef4ea4-3697-4234-9c62-7c8a5ce19e12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b21f813eba943fb89f28face54dca57'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:47.625231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1143/2283] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:47 2022] DELETE /identity/v3/users/4b21f813eba943fb89f28face54dca57 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:49.244063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:49.248069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:49.268588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd507ce-a196-48a7-9464-748ead4e1d1d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:49.419647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:49.421212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:49.421734 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:49.422248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] PATH_INFO: `/v3/projects/1c26eedf54234607a37d17faa2c9bfda` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:49.423756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c26eedf54234607a37d17faa2c9bfda)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:49.432751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:49.548354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c26eedf54234607a37d17faa2c9bfda', 'request_id': 'req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:49.570001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c26eedf54234607a37d17faa2c9bfda', 'request_id': 'req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:49.597819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c26eedf54234607a37d17faa2c9bfda', 'request_id': 'req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:49.610561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] The token cache is being invalidate because project 1c26eedf54234607a37d17faa2c9bfda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:49.611140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:49.611985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2bcd9c0d-e4f0-42f1-8f44-690095e8400d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:49.613742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1141/2284] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:49 2022] DELETE /identity/v3/projects/1c26eedf54234607a37d17faa2c9bfda => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:49.620397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267f89-a649-4ce4-ac91-5285ebd55ec7 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:49.620944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267f89-a649-4ce4-ac91-5285ebd55ec7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:49.620944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa267f89-a649-4ce4-ac91-5285ebd55ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:49.653753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-aa267f89-a649-4ce4-ac91-5285ebd55ec7 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:49.655020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-aa267f89-a649-4ce4-ac91-5285ebd55ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:49.827824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1144/2285] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:49.829798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc49fc-b6e5-4322-b68a-174b10a4a987 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:49.830162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc49fc-b6e5-4322-b68a-174b10a4a987 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:49.830444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc49fc-b6e5-4322-b68a-174b10a4a987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:49.883628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-68cc49fc-b6e5-4322-b68a-174b10a4a987 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:49.883628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-68cc49fc-b6e5-4322-b68a-174b10a4a987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:49.883628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1142/2286] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:49.885288 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267f89-a649-4ce4-ac91-5285ebd55ec7 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:49.938401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa267f89-a649-4ce4-ac91-5285ebd55ec7 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:49.951968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:49.953069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:49.953554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:49.954007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:49.955023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:51:49.955521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:49.958410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:50.013666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1145/2287] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:51:50.015456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc49fc-b6e5-4322-b68a-174b10a4a987 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:50.028413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc49fc-b6e5-4322-b68a-174b10a4a987 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:50.063173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19b11e-793a-4d8a-b592-6318e82e4dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:50.064213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b11e-793a-4d8a-b592-6318e82e4dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:50.064702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b11e-793a-4d8a-b592-6318e82e4dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:50.065202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19b11e-793a-4d8a-b592-6318e82e4dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:50.066145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19b11e-793a-4d8a-b592-6318e82e4dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:50.073285 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19b11e-793a-4d8a-b592-6318e82e4dd3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:50.135233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:50.139434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:50.148898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1143/2288] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:50 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:50.152095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19b11e-793a-4d8a-b592-6318e82e4dd3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:50.308527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19b11e-793a-4d8a-b592-6318e82e4dd3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:50.326848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ef448-847b-4342-9d99-db304c945b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:50.327446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ef448-847b-4342-9d99-db304c945b6e admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:50.327759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ef448-847b-4342-9d99-db304c945b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:50.328034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ef448-847b-4342-9d99-db304c945b6e admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:50.328756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ef448-847b-4342-9d99-db304c945b6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:50.342621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ef448-847b-4342-9d99-db304c945b6e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:50.390518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1144/2289] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:50 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:50.398254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ef448-847b-4342-9d99-db304c945b6e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:50.420659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3603d-9fb2-436c-a14c-f64d8d2f2d23 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:50.421516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ef448-847b-4342-9d99-db304c945b6e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:50.433428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e120b-2146-4f4f-9ede-47b9c454f796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:50.434113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e120b-2146-4f4f-9ede-47b9c454f796 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:50.434395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e120b-2146-4f4f-9ede-47b9c454f796 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:50.434668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e120b-2146-4f4f-9ede-47b9c454f796 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:50.435411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e120b-2146-4f4f-9ede-47b9c454f796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:50.439319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e120b-2146-4f4f-9ede-47b9c454f796 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:50.471444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1145/2290] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:50.473553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e120b-2146-4f4f-9ede-47b9c454f796 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:50.506957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e120b-2146-4f4f-9ede-47b9c454f796 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:50.512675 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f30eb-aed5-45f4-8501-8a1c33f8a628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:50.514211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f30eb-aed5-45f4-8501-8a1c33f8a628 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:50.514735 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f30eb-aed5-45f4-8501-8a1c33f8a628 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:50.515217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f30eb-aed5-45f4-8501-8a1c33f8a628 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:50.516242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f30eb-aed5-45f4-8501-8a1c33f8a628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:50.518137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f30eb-aed5-45f4-8501-8a1c33f8a628 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:50.539926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1146/2291] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:50.541503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f30eb-aed5-45f4-8501-8a1c33f8a628 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:50.564432 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f30eb-aed5-45f4-8501-8a1c33f8a628 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:50.579318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e78f1-6f25-4f5d-b13c-0fab4d7c0eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:50.581164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e78f1-6f25-4f5d-b13c-0fab4d7c0eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:50.582088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e78f1-6f25-4f5d-b13c-0fab4d7c0eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:50.584563 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e78f1-6f25-4f5d-b13c-0fab4d7c0eb9 admin admin] PATH_INFO: `/v3/projects/4f79810eaa734bc59e555dfca397c693/users/fe5580e599e74d1abf0dcf6db9052414/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:50.593281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc1352-472a-4c92-a43f-aa80649fbd88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5bbcf690d144ab99438b3f65b5e100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:50.593961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc1352-472a-4c92-a43f-aa80649fbd88 service placement] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:50.594254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc1352-472a-4c92-a43f-aa80649fbd88 service placement] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:50.594886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc1352-472a-4c92-a43f-aa80649fbd88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:50.602543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ecfc1352-472a-4c92-a43f-aa80649fbd88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:50.626127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc1352-472a-4c92-a43f-aa80649fbd88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:50.630094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e78f1-6f25-4f5d-b13c-0fab4d7c0eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f79810eaa734bc59e555dfca397c693, user_id=fe5580e599e74d1abf0dcf6db9052414, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:50.633755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc1352-472a-4c92-a43f-aa80649fbd88 service placement] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:50.638226 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e78f1-6f25-4f5d-b13c-0fab4d7c0eb9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:50.653569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1146/2292] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:51:50.680349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1147/2293] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:50 2022] PUT /identity/v3/projects/4f79810eaa734bc59e555dfca397c693/users/fe5580e599e74d1abf0dcf6db9052414/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:50.681272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9867-363a-4443-8003-14e9dcad3891 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:50.681596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9867-363a-4443-8003-14e9dcad3891 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:50.681942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9867-363a-4443-8003-14e9dcad3891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:50.794268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-86ba9867-363a-4443-8003-14e9dcad3891 None None] MFA Rules not processed for user `fe5580e599e74d1abf0dcf6db9052414`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:50.795511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-86ba9867-363a-4443-8003-14e9dcad3891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:50.901745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1147/2294] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:50.906075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e78f1-6f25-4f5d-b13c-0fab4d7c0eb9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:50.997394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e78f1-6f25-4f5d-b13c-0fab4d7c0eb9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:51.005955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f77cc-9ff3-467e-8b58-84d44d1ae718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:51.006802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f77cc-9ff3-467e-8b58-84d44d1ae718 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:51.007091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f77cc-9ff3-467e-8b58-84d44d1ae718 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:51.007371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f77cc-9ff3-467e-8b58-84d44d1ae718 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:51.008138 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f77cc-9ff3-467e-8b58-84d44d1ae718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:51.010455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f77cc-9ff3-467e-8b58-84d44d1ae718 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:51.079372 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9867-363a-4443-8003-14e9dcad3891 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:51.080909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1148/2295] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:50 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:51.099560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9867-363a-4443-8003-14e9dcad3891 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:51.201552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502684c-ee88-474e-874e-210f032babef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:51.203619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502684c-ee88-474e-874e-210f032babef admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:51.204759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502684c-ee88-474e-874e-210f032babef admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:51.206873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502684c-ee88-474e-874e-210f032babef admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:51.213566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502684c-ee88-474e-874e-210f032babef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:51.223725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7502684c-ee88-474e-874e-210f032babef admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:51.280708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1148/2296] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:51 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:51.282793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f77cc-9ff3-467e-8b58-84d44d1ae718 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:51.296823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f77cc-9ff3-467e-8b58-84d44d1ae718 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:51.322128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cded4b3-94cd-457e-8644-939827789762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:51.323834 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cded4b3-94cd-457e-8644-939827789762 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:51.324327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cded4b3-94cd-457e-8644-939827789762 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:51.324809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cded4b3-94cd-457e-8644-939827789762 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:51.325797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cded4b3-94cd-457e-8644-939827789762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:51.331480 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cded4b3-94cd-457e-8644-939827789762 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:51.376630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1149/2297] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:51.377773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502684c-ee88-474e-874e-210f032babef admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:51.402247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7502684c-ee88-474e-874e-210f032babef admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:51.426109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d733d3d-34a3-4c45-9057-cc2db35def7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:51.427026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d733d3d-34a3-4c45-9057-cc2db35def7a admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:51.428009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d733d3d-34a3-4c45-9057-cc2db35def7a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:51.428305 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d733d3d-34a3-4c45-9057-cc2db35def7a admin admin] PATH_INFO: `/v3/projects/c784b55327a94384a058d4eea751a6bc/users/83a67f99dc024f99a96953b32808348a/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:51.488334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d733d3d-34a3-4c45-9057-cc2db35def7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c784b55327a94384a058d4eea751a6bc, user_id=83a67f99dc024f99a96953b32808348a, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:51.491297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d733d3d-34a3-4c45-9057-cc2db35def7a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:51.516248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1149/2298] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:51 2022] PUT /identity/v3/projects/c784b55327a94384a058d4eea751a6bc/users/83a67f99dc024f99a96953b32808348a/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:51.520301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cded4b3-94cd-457e-8644-939827789762 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:51.537704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cded4b3-94cd-457e-8644-939827789762 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:51.653179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424627be-2113-49dd-b436-5453837a97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:51.653875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424627be-2113-49dd-b436-5453837a97fc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:51.654181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424627be-2113-49dd-b436-5453837a97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:51.654733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424627be-2113-49dd-b436-5453837a97fc admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:51.655492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424627be-2113-49dd-b436-5453837a97fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:51.657126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424627be-2113-49dd-b436-5453837a97fc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:51.673650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1150/2299] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:51.674360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d733d3d-34a3-4c45-9057-cc2db35def7a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:51.686126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d733d3d-34a3-4c45-9057-cc2db35def7a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:51.691994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0e601-844a-401c-8948-3bd90573e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:51.693039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0e601-844a-401c-8948-3bd90573e10b admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:51.693437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0e601-844a-401c-8948-3bd90573e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:51.693813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0e601-844a-401c-8948-3bd90573e10b admin admin] PATH_INFO: `/v3/projects/c784b55327a94384a058d4eea751a6bc/users/83a67f99dc024f99a96953b32808348a/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:51.696378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0e601-844a-401c-8948-3bd90573e10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c784b55327a94384a058d4eea751a6bc, user_id=83a67f99dc024f99a96953b32808348a, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:51.699236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a0e601-844a-401c-8948-3bd90573e10b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:51.720631 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1150/2300] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:51 2022] PUT /identity/v3/projects/c784b55327a94384a058d4eea751a6bc/users/83a67f99dc024f99a96953b32808348a/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:51.722136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003f36b-78d9-4450-814b-bb6914f491ec None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:51.722653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003f36b-78d9-4450-814b-bb6914f491ec None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:51.722959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003f36b-78d9-4450-814b-bb6914f491ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:51.780928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1003f36b-78d9-4450-814b-bb6914f491ec None None] MFA Rules not processed for user `83a67f99dc024f99a96953b32808348a`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:51.784988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1003f36b-78d9-4450-814b-bb6914f491ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:51.887968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1151/2301] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:51.898262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0e601-844a-401c-8948-3bd90573e10b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:51.901359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-65a0e601-844a-401c-8948-3bd90573e10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:51.975773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0e601-844a-401c-8948-3bd90573e10b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:51.998765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c808b6-7ef1-4da7-bfb3-123695bcbdd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:51.999520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c808b6-7ef1-4da7-bfb3-123695bcbdd0 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:51.999904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c808b6-7ef1-4da7-bfb3-123695bcbdd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:52.000390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c808b6-7ef1-4da7-bfb3-123695bcbdd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:52.074425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c808b6-7ef1-4da7-bfb3-123695bcbdd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:52.078373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c808b6-7ef1-4da7-bfb3-123695bcbdd0 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:52.096159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1151/2302] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:54.561403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003f36b-78d9-4450-814b-bb6914f491ec None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:54.563301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1003f36b-78d9-4450-814b-bb6914f491ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:54.660042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003f36b-78d9-4450-814b-bb6914f491ec None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:54.665122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ec0e4-fae5-412e-b019-c09fab44c096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:54.665957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ec0e4-fae5-412e-b019-c09fab44c096 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:54.666261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ec0e4-fae5-412e-b019-c09fab44c096 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:54.666536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ec0e4-fae5-412e-b019-c09fab44c096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:54.668420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a98ec0e4-fae5-412e-b019-c09fab44c096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:54.762253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c808b6-7ef1-4da7-bfb3-123695bcbdd0 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:54.778775 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ec0e4-fae5-412e-b019-c09fab44c096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:54.783785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ec0e4-fae5-412e-b019-c09fab44c096 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:54.808530 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1152/2303] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:54.881489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c808b6-7ef1-4da7-bfb3-123695bcbdd0 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:54.887927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:54.889683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:54.890378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:54.890866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] PATH_INFO: `/v3/users/fe5580e599e74d1abf0dcf6db9052414` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:54.892416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5580e599e74d1abf0dcf6db9052414)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:54.896030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:54.969105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5580e599e74d1abf0dcf6db9052414'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:54.978221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5580e599e74d1abf0dcf6db9052414'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:54.995337 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5580e599e74d1abf0dcf6db9052414'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:55.005758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5580e599e74d1abf0dcf6db9052414'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:55.006795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5580e599e74d1abf0dcf6db9052414'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:55.020216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1152/2304] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:54 2022] DELETE /identity/v3/users/fe5580e599e74d1abf0dcf6db9052414 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:55.024332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a96902-7329-40e9-b2a8-e972f6f7443e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:55.024721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a96902-7329-40e9-b2a8-e972f6f7443e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:55.025428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a96902-7329-40e9-b2a8-e972f6f7443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:55.061062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-36a96902-7329-40e9-b2a8-e972f6f7443e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:55.062291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-36a96902-7329-40e9-b2a8-e972f6f7443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:55.162856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1153/2305] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:55.173429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:55.176239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:55.293497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7815b06-a329-4ac5-bf2d-5e2853fba358 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:55.296809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba306-4a56-4745-a926-aaecdf1ce40c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:55.297956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba306-4a56-4745-a926-aaecdf1ce40c service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:55.298388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba306-4a56-4745-a926-aaecdf1ce40c service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:55.298793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba306-4a56-4745-a926-aaecdf1ce40c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:55.325277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ba306-4a56-4745-a926-aaecdf1ce40c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:55.328649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ba306-4a56-4745-a926-aaecdf1ce40c service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:55.344479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1153/2306] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:55.828321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a96902-7329-40e9-b2a8-e972f6f7443e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:55.829989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-36a96902-7329-40e9-b2a8-e972f6f7443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:55.857231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a96902-7329-40e9-b2a8-e972f6f7443e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:55.864157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:55.866342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:55.866655 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:55.866942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] PATH_INFO: `/v3/projects/4f79810eaa734bc59e555dfca397c693` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:55.868410 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f79810eaa734bc59e555dfca397c693)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:55.870645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:55.974752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f79810eaa734bc59e555dfca397c693', 'request_id': 'req-a7d89b39-baec-4f44-a500-3183dc82d07a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:55.987825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f79810eaa734bc59e555dfca397c693', 'request_id': 'req-a7d89b39-baec-4f44-a500-3183dc82d07a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:55.995931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f79810eaa734bc59e555dfca397c693', 'request_id': 'req-a7d89b39-baec-4f44-a500-3183dc82d07a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:56.017482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] The token cache is being invalidate because project 4f79810eaa734bc59e555dfca397c693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:56.017938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:56.020269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:56.028858 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1154/2307] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:55 2022] DELETE /identity/v3/projects/4f79810eaa734bc59e555dfca397c693 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:56.029076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba306-4a56-4745-a926-aaecdf1ce40c service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:56.039273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba306-4a56-4745-a926-aaecdf1ce40c service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:56.134438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:56.136609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:56.138811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:56.138968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] PATH_INFO: `/v3/users/83a67f99dc024f99a96953b32808348a` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:56.140201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a67f99dc024f99a96953b32808348a)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:56.147495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:56.219548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a67f99dc024f99a96953b32808348a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:56.231193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a67f99dc024f99a96953b32808348a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:56.251914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a67f99dc024f99a96953b32808348a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:56.266254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a67f99dc024f99a96953b32808348a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:56.267159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2ada7c59-4044-4491-b83e-c667710c284a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a67f99dc024f99a96953b32808348a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:56.280143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1154/2308] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:56 2022] DELETE /identity/v3/users/83a67f99dc024f99a96953b32808348a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:56.980507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:56.982153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:56.996445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d89b39-baec-4f44-a500-3183dc82d07a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:57.095938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:57.098361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.098650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.098930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] PATH_INFO: `/v3/projects/c784b55327a94384a058d4eea751a6bc` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.100202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c784b55327a94384a058d4eea751a6bc)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:57.102162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:57.169961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c784b55327a94384a058d4eea751a6bc', 'request_id': 'req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:57.184382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c784b55327a94384a058d4eea751a6bc', 'request_id': 'req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:57.200414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c784b55327a94384a058d4eea751a6bc', 'request_id': 'req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:57.220396 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] The token cache is being invalidate because project c784b55327a94384a058d4eea751a6bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:57.220764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:57.222840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-480be5d2-74d6-4ca6-a7ef-4f1e12289a4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:57.224694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1155/2309] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:56 2022] DELETE /identity/v3/projects/c784b55327a94384a058d4eea751a6bc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:57.230556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962bb4a-62ca-426d-a297-07280c64a1ae None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.231229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962bb4a-62ca-426d-a297-07280c64a1ae None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.231229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962bb4a-62ca-426d-a297-07280c64a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.259194 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-c962bb4a-62ca-426d-a297-07280c64a1ae None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:57.262442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c962bb4a-62ca-426d-a297-07280c64a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:57.355624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1155/2310] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:57.359350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff01b8c-d7a3-4f80-ad10-278c89f88bca None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.360185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff01b8c-d7a3-4f80-ad10-278c89f88bca None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.360185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff01b8c-d7a3-4f80-ad10-278c89f88bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.386098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-5ff01b8c-d7a3-4f80-ad10-278c89f88bca None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:57.387495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5ff01b8c-d7a3-4f80-ad10-278c89f88bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:57.401999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1156/2311] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:57.403105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962bb4a-62ca-426d-a297-07280c64a1ae None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:57.418414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962bb4a-62ca-426d-a297-07280c64a1ae None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:57.426477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd71ff-5770-48f3-b459-fbec84d2c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:57.427950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd71ff-5770-48f3-b459-fbec84d2c382 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.428236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd71ff-5770-48f3-b459-fbec84d2c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.428514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd71ff-5770-48f3-b459-fbec84d2c382 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.429283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd71ff-5770-48f3-b459-fbec84d2c382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:51:57.429593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd71ff-5770-48f3-b459-fbec84d2c382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:57.431220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd71ff-5770-48f3-b459-fbec84d2c382 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:57.450680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1156/2312] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:51:57.454845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff01b8c-d7a3-4f80-ad10-278c89f88bca None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:57.465960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff01b8c-d7a3-4f80-ad10-278c89f88bca None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:57.471141 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041579-46e1-4071-8fe1-a4db0879e4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:57.472383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041579-46e1-4071-8fe1-a4db0879e4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.472676 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041579-46e1-4071-8fe1-a4db0879e4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.472961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041579-46e1-4071-8fe1-a4db0879e4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.473688 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041579-46e1-4071-8fe1-a4db0879e4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:57.476053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041579-46e1-4071-8fe1-a4db0879e4b5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:57.514749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1157/2313] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:57 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:57.515797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd71ff-5770-48f3-b459-fbec84d2c382 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:57.528957 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd71ff-5770-48f3-b459-fbec84d2c382 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:57.606451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02047338-1a76-4784-ba35-7084c2a4a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:57.606451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02047338-1a76-4784-ba35-7084c2a4a31c admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.606451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02047338-1a76-4784-ba35-7084c2a4a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.606451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02047338-1a76-4784-ba35-7084c2a4a31c admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.606956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02047338-1a76-4784-ba35-7084c2a4a31c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:57.609356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02047338-1a76-4784-ba35-7084c2a4a31c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:57.640015 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1157/2314] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:57 2022] POST /identity/v3/users => generated 286 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:51:57.641987 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041579-46e1-4071-8fe1-a4db0879e4b5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:57.660657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041579-46e1-4071-8fe1-a4db0879e4b5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:57.666080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743043-4907-46d6-894c-51daeddd82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:57.666746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743043-4907-46d6-894c-51daeddd82b9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.667029 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743043-4907-46d6-894c-51daeddd82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.667313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50743043-4907-46d6-894c-51daeddd82b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.668162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50743043-4907-46d6-894c-51daeddd82b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:57.672330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50743043-4907-46d6-894c-51daeddd82b9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:57.687394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1158/2315] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:51:57.691371 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02047338-1a76-4784-ba35-7084c2a4a31c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:57.702899 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02047338-1a76-4784-ba35-7084c2a4a31c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:57.709556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de071a3e-248d-4ab8-81db-f30d94f8fd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:57.712310 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de071a3e-248d-4ab8-81db-f30d94f8fd37 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.712653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de071a3e-248d-4ab8-81db-f30d94f8fd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.712946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de071a3e-248d-4ab8-81db-f30d94f8fd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.713723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de071a3e-248d-4ab8-81db-f30d94f8fd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:57.715396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de071a3e-248d-4ab8-81db-f30d94f8fd37 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:57.730493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1158/2316] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:51:57.731650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743043-4907-46d6-894c-51daeddd82b9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:57.743780 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50743043-4907-46d6-894c-51daeddd82b9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:57.756702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99facf49-92d2-4267-9349-83e314383a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:57.758217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99facf49-92d2-4267-9349-83e314383a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.758746 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99facf49-92d2-4267-9349-83e314383a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.759244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99facf49-92d2-4267-9349-83e314383a19 admin admin] PATH_INFO: `/v3/projects/5b3c4cafcfcc42319f1fdac0057e6629/users/e29e8a4cd4d04c9a8f32b7ba59b35561/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.789368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99facf49-92d2-4267-9349-83e314383a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3c4cafcfcc42319f1fdac0057e6629, user_id=e29e8a4cd4d04c9a8f32b7ba59b35561, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:57.792561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99facf49-92d2-4267-9349-83e314383a19 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:57.819497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1159/2317] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:57 2022] PUT /identity/v3/projects/5b3c4cafcfcc42319f1fdac0057e6629/users/e29e8a4cd4d04c9a8f32b7ba59b35561/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:57.829380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04a3f-15f3-484d-b1f1-d20607cb2640 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:57.829692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04a3f-15f3-484d-b1f1-d20607cb2640 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:57.829950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e04a3f-15f3-484d-b1f1-d20607cb2640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:57.887587 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e5e04a3f-15f3-484d-b1f1-d20607cb2640 None None] MFA Rules not processed for user `e29e8a4cd4d04c9a8f32b7ba59b35561`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:57.889804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e5e04a3f-15f3-484d-b1f1-d20607cb2640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:57.980068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1159/2318] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:57.992603 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99facf49-92d2-4267-9349-83e314383a19 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:57.995243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-99facf49-92d2-4267-9349-83e314383a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:58.071189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99facf49-92d2-4267-9349-83e314383a19 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:58.077034 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f85581-2290-4aac-9788-2cc1e364bc9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:58.077703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85581-2290-4aac-9788-2cc1e364bc9d service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:58.077983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85581-2290-4aac-9788-2cc1e364bc9d service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:58.078258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f85581-2290-4aac-9788-2cc1e364bc9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:58.088350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85581-2290-4aac-9788-2cc1e364bc9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:58.089781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f85581-2290-4aac-9788-2cc1e364bc9d service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:58.109385 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1160/2319] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:51:58.140976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04a3f-15f3-484d-b1f1-d20607cb2640 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:58.221690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e04a3f-15f3-484d-b1f1-d20607cb2640 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:58.234876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:58.236520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:58.237090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:58.238262 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] PATH_INFO: `/v3/users/e29e8a4cd4d04c9a8f32b7ba59b35561` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:58.240093 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29e8a4cd4d04c9a8f32b7ba59b35561)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:58.242428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:58.317868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29e8a4cd4d04c9a8f32b7ba59b35561'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:58.329037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29e8a4cd4d04c9a8f32b7ba59b35561'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:58.345860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29e8a4cd4d04c9a8f32b7ba59b35561'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:58.356711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29e8a4cd4d04c9a8f32b7ba59b35561'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:58.357531 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29e8a4cd4d04c9a8f32b7ba59b35561'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:58.374072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4ab4-edaa-4406-8a0a-1bd53958030d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:58.374318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4ab4-edaa-4406-8a0a-1bd53958030d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:58.374584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e4ab4-edaa-4406-8a0a-1bd53958030d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:58.376574 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1160/2320] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:51:58 2022] DELETE /identity/v3/users/e29e8a4cd4d04c9a8f32b7ba59b35561 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:58.400868 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ca8e4ab4-edaa-4406-8a0a-1bd53958030d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:58.403426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ca8e4ab4-edaa-4406-8a0a-1bd53958030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:58.522395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1161/2321] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:58.528817 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:58.530590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:58.617110 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3bc831-a957-4d9b-8b04-b4ea2a990c15 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:58.621990 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb74968-038d-4aa6-a953-7d4809c33835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:58.625609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb74968-038d-4aa6-a953-7d4809c33835 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:58.625939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb74968-038d-4aa6-a953-7d4809c33835 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:58.626293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb74968-038d-4aa6-a953-7d4809c33835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:58.638621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb74968-038d-4aa6-a953-7d4809c33835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:58.640600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb74968-038d-4aa6-a953-7d4809c33835 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:58.660492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1161/2322] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:51:59.078852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4ab4-edaa-4406-8a0a-1bd53958030d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:59.082083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ca8e4ab4-edaa-4406-8a0a-1bd53958030d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:59.098666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e4ab4-edaa-4406-8a0a-1bd53958030d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:59.108549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:59.109518 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.110145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.110323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] PATH_INFO: `/v3/projects/5b3c4cafcfcc42319f1fdac0057e6629` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:59.112527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3c4cafcfcc42319f1fdac0057e6629)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:59.114562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:59.226270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3c4cafcfcc42319f1fdac0057e6629', 'request_id': 'req-436337a0-361d-4c44-8e52-62c093f7bbcd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:59.237889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3c4cafcfcc42319f1fdac0057e6629', 'request_id': 'req-436337a0-361d-4c44-8e52-62c093f7bbcd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:59.246153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3c4cafcfcc42319f1fdac0057e6629', 'request_id': 'req-436337a0-361d-4c44-8e52-62c093f7bbcd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:59.272379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] The token cache is being invalidate because project 5b3c4cafcfcc42319f1fdac0057e6629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:51:59.272666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:59.273366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-436337a0-361d-4c44-8e52-62c093f7bbcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:51:59.279266 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1162/2323] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:51:59 2022] DELETE /identity/v3/projects/5b3c4cafcfcc42319f1fdac0057e6629 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:51:59.281080 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199db01-4778-4efb-83c2-af1fbe703b93 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.281586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199db01-4778-4efb-83c2-af1fbe703b93 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.281586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199db01-4778-4efb-83c2-af1fbe703b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:59.312912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-9199db01-4778-4efb-83c2-af1fbe703b93 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:59.314170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9199db01-4778-4efb-83c2-af1fbe703b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:59.432292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1162/2324] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:51:59.432867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2dc93-c3b8-4218-b98a-05f2394875ea None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.433390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2dc93-c3b8-4218-b98a-05f2394875ea None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.433871 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2dc93-c3b8-4218-b98a-05f2394875ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:59.478498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-dac2dc93-c3b8-4218-b98a-05f2394875ea None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:51:59.482910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-dac2dc93-c3b8-4218-b98a-05f2394875ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:51:59.506191 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1163/2325] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:51:59.508430 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199db01-4778-4efb-83c2-af1fbe703b93 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:59.539538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199db01-4778-4efb-83c2-af1fbe703b93 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:59.556368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d8769-c712-45f6-9e3a-f3d144e64de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:59.557407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d8769-c712-45f6-9e3a-f3d144e64de1 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.559119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d8769-c712-45f6-9e3a-f3d144e64de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.559841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d8769-c712-45f6-9e3a-f3d144e64de1 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:59.560965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d8769-c712-45f6-9e3a-f3d144e64de1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:51:59.561557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d8769-c712-45f6-9e3a-f3d144e64de1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:59.563523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d8769-c712-45f6-9e3a-f3d144e64de1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:59.588070 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2dc93-c3b8-4218-b98a-05f2394875ea None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:59.599312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1163/2326] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:51:59.600645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2dc93-c3b8-4218-b98a-05f2394875ea None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:59.606565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ab42a-3432-4654-b0d0-dda4e8c887c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:59.607371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ab42a-3432-4654-b0d0-dda4e8c887c9 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.607829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ab42a-3432-4654-b0d0-dda4e8c887c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.608214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ab42a-3432-4654-b0d0-dda4e8c887c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:59.609576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ab42a-3432-4654-b0d0-dda4e8c887c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:59.612370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ab42a-3432-4654-b0d0-dda4e8c887c9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:59.661486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d8769-c712-45f6-9e3a-f3d144e64de1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:59.663767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1164/2327] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:51:59 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:59.687978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d8769-c712-45f6-9e3a-f3d144e64de1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:59.777363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe723386-2adb-4d77-a834-302f91e7b43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:59.782792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe723386-2adb-4d77-a834-302f91e7b43c admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.782792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe723386-2adb-4d77-a834-302f91e7b43c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.782792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe723386-2adb-4d77-a834-302f91e7b43c admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:59.782792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe723386-2adb-4d77-a834-302f91e7b43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:59.782792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe723386-2adb-4d77-a834-302f91e7b43c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:59.816830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1164/2328] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:51:59 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:51:59.821256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ab42a-3432-4654-b0d0-dda4e8c887c9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:59.835674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ab42a-3432-4654-b0d0-dda4e8c887c9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:59.841465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3df71d-14ed-4f92-b1c4-10e1f0a028f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:59.842429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3df71d-14ed-4f92-b1c4-10e1f0a028f9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.842807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3df71d-14ed-4f92-b1c4-10e1f0a028f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.843161 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3df71d-14ed-4f92-b1c4-10e1f0a028f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:59.844044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3df71d-14ed-4f92-b1c4-10e1f0a028f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:59.845742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3df71d-14ed-4f92-b1c4-10e1f0a028f9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:59.865013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe723386-2adb-4d77-a834-302f91e7b43c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:59.865220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1165/2329] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:59.881417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe723386-2adb-4d77-a834-302f91e7b43c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:59.889534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45949ba0-38ea-4c6b-9663-99ea1c5b138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:59.890479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949ba0-38ea-4c6b-9663-99ea1c5b138b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.890904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949ba0-38ea-4c6b-9663-99ea1c5b138b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.891189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949ba0-38ea-4c6b-9663-99ea1c5b138b admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:59.892346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45949ba0-38ea-4c6b-9663-99ea1c5b138b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:59.894897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45949ba0-38ea-4c6b-9663-99ea1c5b138b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:59.907786 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1165/2330] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:51:59.911981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3df71d-14ed-4f92-b1c4-10e1f0a028f9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:51:59.926470 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3df71d-14ed-4f92-b1c4-10e1f0a028f9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:51:59.934499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064d469-0c1a-4608-92ca-22dd632549e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:51:59.935480 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064d469-0c1a-4608-92ca-22dd632549e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.935861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064d469-0c1a-4608-92ca-22dd632549e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.936211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064d469-0c1a-4608-92ca-22dd632549e3 admin admin] PATH_INFO: `/v3/projects/fe08ade68b284511b92c42fba70f29d3/users/f949c79110dd4ceaa532c18230e00a38/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:51:59.959294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064d469-0c1a-4608-92ca-22dd632549e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe08ade68b284511b92c42fba70f29d3, user_id=f949c79110dd4ceaa532c18230e00a38, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:51:59.963832 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064d469-0c1a-4608-92ca-22dd632549e3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:51:59.989962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1166/2331] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:51:59 2022] PUT /identity/v3/projects/fe08ade68b284511b92c42fba70f29d3/users/f949c79110dd4ceaa532c18230e00a38/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:51:59.992083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060327-4d56-442d-a26f-ea41eaf878ff None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:51:59.992374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060327-4d56-442d-a26f-ea41eaf878ff None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:51:59.992655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060327-4d56-442d-a26f-ea41eaf878ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:00.023817 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-74060327-4d56-442d-a26f-ea41eaf878ff None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:00.026741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-74060327-4d56-442d-a26f-ea41eaf878ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:00.054625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe69a-e697-46e5-9a4b-1b3c4b275e9c None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:00.054968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe69a-e697-46e5-9a4b-1b3c4b275e9c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:00.055195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffe69a-e697-46e5-9a4b-1b3c4b275e9c None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:00.057159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1167/2332] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jan 27 16:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jan 27 16:52:00.065850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d42b8e-3ef3-4199-b8b2-11258e41e1f1 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:00.066578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d42b8e-3ef3-4199-b8b2-11258e41e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:00.066988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d42b8e-3ef3-4199-b8b2-11258e41e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:00.125669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1166/2333] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:00.136541 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74060327-4d56-442d-a26f-ea41eaf878ff None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:00.138393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-74060327-4d56-442d-a26f-ea41eaf878ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:00.149743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-60d42b8e-3ef3-4199-b8b2-11258e41e1f1 None None] MFA Rules not processed for user `8500a8d242bf43a9b2fd538c3b1bb037`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:00.150950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-60d42b8e-3ef3-4199-b8b2-11258e41e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:00.235125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74060327-4d56-442d-a26f-ea41eaf878ff None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:00.240418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4be9f-1ae2-42a7-a491-ad05cfb6c179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:00.241938 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4be9f-1ae2-42a7-a491-ad05cfb6c179 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:00.242415 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4be9f-1ae2-42a7-a491-ad05cfb6c179 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:00.242994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4be9f-1ae2-42a7-a491-ad05cfb6c179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:00.256522 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4be9f-1ae2-42a7-a491-ad05cfb6c179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:00.260959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4be9f-1ae2-42a7-a491-ad05cfb6c179 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:00.286471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1167/2334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:52:00.299727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1168/2335] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jan 27 16:52:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:52:00.312152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4be9f-1ae2-42a7-a491-ad05cfb6c179 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:00.313783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-dff4be9f-1ae2-42a7-a491-ad05cfb6c179 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:00.398489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4be9f-1ae2-42a7-a491-ad05cfb6c179 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:00.404689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d75d56-71ac-45c9-b600-8e1edc59d5cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '295fe8f61f87423bb49471e2f0085690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:00.406641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d75d56-71ac-45c9-b600-8e1edc59d5cc service glance] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:00.407217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d75d56-71ac-45c9-b600-8e1edc59d5cc service glance] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:00.407827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d75d56-71ac-45c9-b600-8e1edc59d5cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:00.432336 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d75d56-71ac-45c9-b600-8e1edc59d5cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:00.436622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d75d56-71ac-45c9-b600-8e1edc59d5cc service glance] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:00.449213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1168/2336] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:52:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:52:00.586304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605abb45-f39f-49f9-bcae-d9bcdff2e44f None None] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:00.586304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605abb45-f39f-49f9-bcae-d9bcdff2e44f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:00.586304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605abb45-f39f-49f9-bcae-d9bcdff2e44f None None] PATH_INFO: `/` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:00.588143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1169/2337] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jan 27 16:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:52:00.594697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2907f-7134-4a7c-9d1e-956915f0298e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:00.594993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2907f-7134-4a7c-9d1e-956915f0298e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:00.595279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2907f-7134-4a7c-9d1e-956915f0298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:00.625013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-57b2907f-7134-4a7c-9d1e-956915f0298e None None] MFA Rules not processed for user `15ae418635734639a4d10676978e82cf`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:00.627233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-57b2907f-7134-4a7c-9d1e-956915f0298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:00.637887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1169/2338] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jan 27 16:52:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:00.657009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605abb45-f39f-49f9-bcae-d9bcdff2e44f None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:00.659984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-605abb45-f39f-49f9-bcae-d9bcdff2e44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:00.678192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605abb45-f39f-49f9-bcae-d9bcdff2e44f None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:00.686678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bcf4c-5a96-4991-930c-38e6a6030648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:00.687419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bcf4c-5a96-4991-930c-38e6a6030648 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:00.687807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bcf4c-5a96-4991-930c-38e6a6030648 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:00.688194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4bcf4c-5a96-4991-930c-38e6a6030648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:00.697695 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bcf4c-5a96-4991-930c-38e6a6030648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:00.699263 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4bcf4c-5a96-4991-930c-38e6a6030648 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:00.740073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1170/2339] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:52:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:52:06.604557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88404a-6952-4fc2-8ac5-5c362a7bf5c6 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:06.605096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88404a-6952-4fc2-8ac5-5c362a7bf5c6 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:06.605096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88404a-6952-4fc2-8ac5-5c362a7bf5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:06.637682 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-dd88404a-6952-4fc2-8ac5-5c362a7bf5c6 None None] MFA Rules not processed for user `f949c79110dd4ceaa532c18230e00a38`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:06.639102 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-dd88404a-6952-4fc2-8ac5-5c362a7bf5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:06.724508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1170/2340] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:52:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:06.725946 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bcf4c-5a96-4991-930c-38e6a6030648 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:06.739450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4bcf4c-5a96-4991-930c-38e6a6030648 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:06.745556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e39246-2dff-406d-b7b4-cd559c2b924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:06.746220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e39246-2dff-406d-b7b4-cd559c2b924d admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:06.747075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e39246-2dff-406d-b7b4-cd559c2b924d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:06.747371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e39246-2dff-406d-b7b4-cd559c2b924d admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:06.748132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e39246-2dff-406d-b7b4-cd559c2b924d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:06.750801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e39246-2dff-406d-b7b4-cd559c2b924d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:06.782637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1171/2341] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:52:06 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:52:06.786741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88404a-6952-4fc2-8ac5-5c362a7bf5c6 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:06.798487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88404a-6952-4fc2-8ac5-5c362a7bf5c6 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:06.916405 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb859e-4751-4a3b-915b-b3dd990dd908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:06.917103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb859e-4751-4a3b-915b-b3dd990dd908 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:06.917393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb859e-4751-4a3b-915b-b3dd990dd908 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:06.917834 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb859e-4751-4a3b-915b-b3dd990dd908 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:06.918396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb859e-4751-4a3b-915b-b3dd990dd908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:06.920711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb859e-4751-4a3b-915b-b3dd990dd908 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:06.958217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1171/2342] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:52:06 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:52:06.964022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e39246-2dff-406d-b7b4-cd559c2b924d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:06.980242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e39246-2dff-406d-b7b4-cd559c2b924d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:06.985870 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4599ffb-6407-4976-bece-13f72e5ef5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:06.987409 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4599ffb-6407-4976-bece-13f72e5ef5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:06.987778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4599ffb-6407-4976-bece-13f72e5ef5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:06.988310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4599ffb-6407-4976-bece-13f72e5ef5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:06.989151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4599ffb-6407-4976-bece-13f72e5ef5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:06.990872 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4599ffb-6407-4976-bece-13f72e5ef5a9 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:07.037195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1172/2343] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:52:07.041061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb859e-4751-4a3b-915b-b3dd990dd908 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:07.062878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb859e-4751-4a3b-915b-b3dd990dd908 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:07.068404 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70200fc8-f9b1-48ce-ab47-455cbbc8d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:07.069507 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70200fc8-f9b1-48ce-ab47-455cbbc8d4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:07.070088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70200fc8-f9b1-48ce-ab47-455cbbc8d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:07.070517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70200fc8-f9b1-48ce-ab47-455cbbc8d4eb admin admin] PATH_INFO: `/v3/projects/3814dcff748c42e4889966e4502af247/users/6e76928bff904d77b8a0e03170930502/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:07.091150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70200fc8-f9b1-48ce-ab47-455cbbc8d4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3814dcff748c42e4889966e4502af247, user_id=6e76928bff904d77b8a0e03170930502, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:07.093357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70200fc8-f9b1-48ce-ab47-455cbbc8d4eb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:07.119202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1172/2344] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:52:07 2022] PUT /identity/v3/projects/3814dcff748c42e4889966e4502af247/users/6e76928bff904d77b8a0e03170930502/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:52:07.122978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4599ffb-6407-4976-bece-13f72e5ef5a9 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:07.137743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4599ffb-6407-4976-bece-13f72e5ef5a9 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:07.230824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad137526-eee9-470f-a84d-f1ee78956879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:07.232464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137526-eee9-470f-a84d-f1ee78956879 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:07.233467 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137526-eee9-470f-a84d-f1ee78956879 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:07.233921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137526-eee9-470f-a84d-f1ee78956879 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:07.235169 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad137526-eee9-470f-a84d-f1ee78956879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:07.238115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad137526-eee9-470f-a84d-f1ee78956879 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:07.251934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1173/2345] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:52:07.256251 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70200fc8-f9b1-48ce-ab47-455cbbc8d4eb admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:07.281872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70200fc8-f9b1-48ce-ab47-455cbbc8d4eb admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:07.287929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a8118-71fb-47ce-a6a1-261d44ff98ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:07.288830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a8118-71fb-47ce-a6a1-261d44ff98ce admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:07.289125 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a8118-71fb-47ce-a6a1-261d44ff98ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:07.289412 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5a8118-71fb-47ce-a6a1-261d44ff98ce admin admin] PATH_INFO: `/v3/projects/3814dcff748c42e4889966e4502af247/users/6e76928bff904d77b8a0e03170930502/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:07.291638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a8118-71fb-47ce-a6a1-261d44ff98ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3814dcff748c42e4889966e4502af247, user_id=6e76928bff904d77b8a0e03170930502, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:07.294282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5a8118-71fb-47ce-a6a1-261d44ff98ce admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:07.305939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1173/2346] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:52:07 2022] PUT /identity/v3/projects/3814dcff748c42e4889966e4502af247/users/6e76928bff904d77b8a0e03170930502/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:52:08.412130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08003-dabd-4133-8acf-14ddb935b350 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:08.413275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08003-dabd-4133-8acf-14ddb935b350 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:08.414215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e08003-dabd-4133-8acf-14ddb935b350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:08.449801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-33e08003-dabd-4133-8acf-14ddb935b350 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:08.451464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-33e08003-dabd-4133-8acf-14ddb935b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:08.552816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1174/2347] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jan 27 16:52:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:08.573869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a8118-71fb-47ce-a6a1-261d44ff98ce admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:08.575469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9e5a8118-71fb-47ce-a6a1-261d44ff98ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:08.736001 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5a8118-71fb-47ce-a6a1-261d44ff98ce admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:08.742313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f866-4945-456d-bf41-7db9784f13cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:08.742989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f866-4945-456d-bf41-7db9784f13cd service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:08.743357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f866-4945-456d-bf41-7db9784f13cd service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:08.743740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f866-4945-456d-bf41-7db9784f13cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:08.752822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550f866-4945-456d-bf41-7db9784f13cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:08.754492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550f866-4945-456d-bf41-7db9784f13cd service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:08.764872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1174/2348] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:52:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:52:09.204858 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60cd05-b025-4d9c-a650-61148837ce92 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:09.206208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60cd05-b025-4d9c-a650-61148837ce92 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:09.207289 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60cd05-b025-4d9c-a650-61148837ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:09.234129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-cd60cd05-b025-4d9c-a650-61148837ce92 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:09.235587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cd60cd05-b025-4d9c-a650-61148837ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:09.244896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1175/2349] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:09.263699 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f866-4945-456d-bf41-7db9784f13cd service swift] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:09.281229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550f866-4945-456d-bf41-7db9784f13cd service swift] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:09.292177 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fe18e-8a3c-40ac-9381-06b3ba1ee30b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:09.293564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fe18e-8a3c-40ac-9381-06b3ba1ee30b service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:09.294192 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fe18e-8a3c-40ac-9381-06b3ba1ee30b service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:09.295197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fe18e-8a3c-40ac-9381-06b3ba1ee30b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:09.313462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fe18e-8a3c-40ac-9381-06b3ba1ee30b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:09.316246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fe18e-8a3c-40ac-9381-06b3ba1ee30b service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:09.326118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1175/2350] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:52:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:52:12.121201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60cd05-b025-4d9c-a650-61148837ce92 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:12.122818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cd60cd05-b025-4d9c-a650-61148837ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:12.329462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60cd05-b025-4d9c-a650-61148837ce92 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:12.336479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:12.337597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:12.338031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:12.338456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] PATH_INFO: `/v3/users/8c67a45bdb0d4dcfbd59e88c6eb6f7f5` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:12.339877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c67a45bdb0d4dcfbd59e88c6eb6f7f5)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:12.341989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:12.474426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:12.507678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:12.508052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:12.581564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:12.611433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d632ba5a-9023-4cea-bec5-66337c03ae72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c67a45bdb0d4dcfbd59e88c6eb6f7f5'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:12.628029 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1176/2351] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:52:12 2022] DELETE /identity/v3/users/8c67a45bdb0d4dcfbd59e88c6eb6f7f5 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:52:15.102018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fe18e-8a3c-40ac-9381-06b3ba1ee30b service swift] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:15.128703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fe18e-8a3c-40ac-9381-06b3ba1ee30b service swift] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:15.249903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:15.251176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:15.251590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:15.252617 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] PATH_INFO: `/v3/projects/a92d0592f8f14b89a36b145413b2fbe1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:15.254128 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92d0592f8f14b89a36b145413b2fbe1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:15.256281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:15.318053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92d0592f8f14b89a36b145413b2fbe1', 'request_id': 'req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:15.331823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92d0592f8f14b89a36b145413b2fbe1', 'request_id': 'req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:15.338173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92d0592f8f14b89a36b145413b2fbe1', 'request_id': 'req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:15.358026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] The token cache is being invalidate because project a92d0592f8f14b89a36b145413b2fbe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:52:15.363625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:15.363625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:15.367123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1176/2352] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:52:15 2022] DELETE /identity/v3/projects/a92d0592f8f14b89a36b145413b2fbe1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:52:16.890849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe9935-5bf9-4884-ab24-14c9fd8db94d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:16.891503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe9935-5bf9-4884-ab24-14c9fd8db94d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:16.891794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe9935-5bf9-4884-ab24-14c9fd8db94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:16.966592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1fbe9935-5bf9-4884-ab24-14c9fd8db94d None None] MFA Rules not processed for user `6e76928bff904d77b8a0e03170930502`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:16.968982 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1fbe9935-5bf9-4884-ab24-14c9fd8db94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:17.118050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1177/2353] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:17.130720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:17.132088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:17.236659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74588c-39c6-43ff-8e0d-7b026ac3fe1d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:17.241827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '295fe8f61f87423bb49471e2f0085690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:17.242648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:17.243042 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:17.243446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:17.246458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:17.327676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:17.333235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:17.340529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1177/2354] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:52:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:52:17.523623 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee3035-8d09-4e72-a35a-a1feb247c825 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:17.524421 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee3035-8d09-4e72-a35a-a1feb247c825 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:17.524932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee3035-8d09-4e72-a35a-a1feb247c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:17.600597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1eee3035-8d09-4e72-a35a-a1feb247c825 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:17.602136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1eee3035-8d09-4e72-a35a-a1feb247c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:17.708346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1178/2355] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:52:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:17.727919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:17.729671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:17.836480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d39c85-fc21-4493-ad8a-d00c41347568 service glance] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:17.841633 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b59d6-d0a4-4548-af91-ea66d3ddf55c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:17.842294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b59d6-d0a4-4548-af91-ea66d3ddf55c service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:17.842577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b59d6-d0a4-4548-af91-ea66d3ddf55c service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:17.842858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b59d6-d0a4-4548-af91-ea66d3ddf55c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:17.852708 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b59d6-d0a4-4548-af91-ea66d3ddf55c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:17.854313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b59d6-d0a4-4548-af91-ea66d3ddf55c service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:17.863055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1178/2356] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:52:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:52:27.512759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1045c-62df-44f7-a30c-e34e69ddb05d None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:27.513278 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1045c-62df-44f7-a30c-e34e69ddb05d None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:27.513384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1045c-62df-44f7-a30c-e34e69ddb05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:27.531131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-edc1045c-62df-44f7-a30c-e34e69ddb05d None None] MFA Rules not processed for user `f949c79110dd4ceaa532c18230e00a38`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:27.533072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-edc1045c-62df-44f7-a30c-e34e69ddb05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:27.540062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1179/2357] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:29.377014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105c791-9345-45ed-8a6d-84a0c7ecc0bf None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:29.377551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105c791-9345-45ed-8a6d-84a0c7ecc0bf None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:29.377725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105c791-9345-45ed-8a6d-84a0c7ecc0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:29.396267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-6105c791-9345-45ed-8a6d-84a0c7ecc0bf None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:29.397480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6105c791-9345-45ed-8a6d-84a0c7ecc0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:29.404745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1179/2358] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:52:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:29.418096 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1045c-62df-44f7-a30c-e34e69ddb05d None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:29.429860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1045c-62df-44f7-a30c-e34e69ddb05d None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:29.435430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f22be-5686-468b-8a2c-b83d126d760f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:29.436112 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f22be-5686-468b-8a2c-b83d126d760f service swift] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:29.436570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f22be-5686-468b-8a2c-b83d126d760f service swift] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:29.437091 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f22be-5686-468b-8a2c-b83d126d760f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:29.446668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f22be-5686-468b-8a2c-b83d126d760f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:29.448345 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f22be-5686-468b-8a2c-b83d126d760f service swift] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:29.457164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1180/2359] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:52:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:52:35.277752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235488e5-74be-4cd0-9365-5c6069943f9d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:35.278341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235488e5-74be-4cd0-9365-5c6069943f9d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:35.278341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235488e5-74be-4cd0-9365-5c6069943f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:35.298163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-235488e5-74be-4cd0-9365-5c6069943f9d None None] MFA Rules not processed for user `7f0c0ea1e431437880ed43ef1c9cb1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:35.300659 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-235488e5-74be-4cd0-9365-5c6069943f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:35.360989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1180/2360] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:52:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:41.184033 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dcce-10ff-41b4-b163-91f1b90dc729 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:41.184587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dcce-10ff-41b4-b163-91f1b90dc729 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:41.184587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dcce-10ff-41b4-b163-91f1b90dc729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:41.202199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-fee9dcce-10ff-41b4-b163-91f1b90dc729 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:41.203934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-fee9dcce-10ff-41b4-b163-91f1b90dc729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:41.211382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1181/2361] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jan 27 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:41.237737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235488e5-74be-4cd0-9365-5c6069943f9d None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:41.251473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235488e5-74be-4cd0-9365-5c6069943f9d None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:41.257066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582d24c-1d9c-4551-a5e7-38c55879c402 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:41.257730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582d24c-1d9c-4551-a5e7-38c55879c402 service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:41.258021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582d24c-1d9c-4551-a5e7-38c55879c402 service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:41.258351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b582d24c-1d9c-4551-a5e7-38c55879c402 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:41.268165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582d24c-1d9c-4551-a5e7-38c55879c402 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:41.270250 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b582d24c-1d9c-4551-a5e7-38c55879c402 service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:41.278994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1181/2362] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:52:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:52:53.969759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dcce-10ff-41b4-b163-91f1b90dc729 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:53.971253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-fee9dcce-10ff-41b4-b163-91f1b90dc729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:54.040357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dcce-10ff-41b4-b163-91f1b90dc729 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:54.045129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:54.046044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.046329 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.047185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] PATH_INFO: `/v3/users/c2c8a269081c42abae453a5be4772d50` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.049152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c8a269081c42abae453a5be4772d50)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:54.051129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:54.100925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c8a269081c42abae453a5be4772d50'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.107957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c8a269081c42abae453a5be4772d50'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.108629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c8a269081c42abae453a5be4772d50'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.120934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c8a269081c42abae453a5be4772d50'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.129428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-d5a4bc49-cf8a-4d19-b53a-d40856c078fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c8a269081c42abae453a5be4772d50'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.136132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1182/2363] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:52:53 2022] DELETE /identity/v3/users/c2c8a269081c42abae453a5be4772d50 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:52:54.348461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582d24c-1d9c-4551-a5e7-38c55879c402 service swift] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:54.362645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b582d24c-1d9c-4551-a5e7-38c55879c402 service swift] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:54.439128 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:54.440143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.440540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.440830 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] PATH_INFO: `/v3/projects/326cd822c847423ba2417f593ca8c6ff` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.442104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=326cd822c847423ba2417f593ca8c6ff)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:54.444036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:54.492935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326cd822c847423ba2417f593ca8c6ff', 'request_id': 'req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.500252 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326cd822c847423ba2417f593ca8c6ff', 'request_id': 'req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.510730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326cd822c847423ba2417f593ca8c6ff', 'request_id': 'req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.521887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] The token cache is being invalidate because project 326cd822c847423ba2417f593ca8c6ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:52:54.522330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.522976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c816c47e-4c7c-4f3b-84b4-da0cde6e0f07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:52:54.525136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1182/2364] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:52:54 2022] DELETE /identity/v3/projects/326cd822c847423ba2417f593ca8c6ff => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:52:54.530992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea60b66-5063-488e-a8bd-f6e0976c0f0b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.531287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea60b66-5063-488e-a8bd-f6e0976c0f0b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.531599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea60b66-5063-488e-a8bd-f6e0976c0f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.550769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-cea60b66-5063-488e-a8bd-f6e0976c0f0b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:54.552039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cea60b66-5063-488e-a8bd-f6e0976c0f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:54.618302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1183/2365] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:54.627419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17c8e-08c3-45c4-9009-a2dbe14b1bc2 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.627676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17c8e-08c3-45c4-9009-a2dbe14b1bc2 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.628205 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17c8e-08c3-45c4-9009-a2dbe14b1bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.647599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-33a17c8e-08c3-45c4-9009-a2dbe14b1bc2 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:54.648820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-33a17c8e-08c3-45c4-9009-a2dbe14b1bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:54.656948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1183/2366] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:52:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:54.661438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea60b66-5063-488e-a8bd-f6e0976c0f0b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:54.670978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea60b66-5063-488e-a8bd-f6e0976c0f0b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:54.676129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10906bd0-7cf3-4264-9a65-4f453e984736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:54.676785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10906bd0-7cf3-4264-9a65-4f453e984736 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.677068 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10906bd0-7cf3-4264-9a65-4f453e984736 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.677346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10906bd0-7cf3-4264-9a65-4f453e984736 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.678082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10906bd0-7cf3-4264-9a65-4f453e984736 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:52:54.678439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10906bd0-7cf3-4264-9a65-4f453e984736 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:54.680171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10906bd0-7cf3-4264-9a65-4f453e984736 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:54.692628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1184/2367] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:52:54.697476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a17c8e-08c3-45c4-9009-a2dbe14b1bc2 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:54.707555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a17c8e-08c3-45c4-9009-a2dbe14b1bc2 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:54.712471 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef089ed3-6346-4b0e-9994-f55af7bffa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:54.713311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef089ed3-6346-4b0e-9994-f55af7bffa5f admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.713598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef089ed3-6346-4b0e-9994-f55af7bffa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.713907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef089ed3-6346-4b0e-9994-f55af7bffa5f admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.714674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef089ed3-6346-4b0e-9994-f55af7bffa5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:54.716678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef089ed3-6346-4b0e-9994-f55af7bffa5f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:54.747393 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1184/2368] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:52:54 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:52:54.752056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10906bd0-7cf3-4264-9a65-4f453e984736 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:54.763274 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10906bd0-7cf3-4264-9a65-4f453e984736 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:54.819694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1edd0-1b06-4e0e-b1af-ae8009afddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:54.820358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1edd0-1b06-4e0e-b1af-ae8009afddc6 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.820645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1edd0-1b06-4e0e-b1af-ae8009afddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.820922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1edd0-1b06-4e0e-b1af-ae8009afddc6 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.821623 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1edd0-1b06-4e0e-b1af-ae8009afddc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:54.823533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1edd0-1b06-4e0e-b1af-ae8009afddc6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:54.842445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1185/2369] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:52:54 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:52:54.846801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef089ed3-6346-4b0e-9994-f55af7bffa5f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:54.857473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef089ed3-6346-4b0e-9994-f55af7bffa5f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:54.862772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53375d-7c1f-4c15-aed6-c3591b7b9b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:54.863432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53375d-7c1f-4c15-aed6-c3591b7b9b7c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.863750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53375d-7c1f-4c15-aed6-c3591b7b9b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.864033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53375d-7c1f-4c15-aed6-c3591b7b9b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.864774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53375d-7c1f-4c15-aed6-c3591b7b9b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:54.866372 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53375d-7c1f-4c15-aed6-c3591b7b9b7c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:54.877491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1185/2370] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:52:54.881898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1edd0-1b06-4e0e-b1af-ae8009afddc6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:54.892269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1edd0-1b06-4e0e-b1af-ae8009afddc6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:54.897319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0bd6-a6d3-4da1-a6d0-1556105ba1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:54.898020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0bd6-a6d3-4da1-a6d0-1556105ba1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.898377 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0bd6-a6d3-4da1-a6d0-1556105ba1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.898661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0bd6-a6d3-4da1-a6d0-1556105ba1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.899402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae0bd6-a6d3-4da1-a6d0-1556105ba1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:54.901035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae0bd6-a6d3-4da1-a6d0-1556105ba1b0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:54.920730 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1186/2371] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:52:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:52:54.927928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53375d-7c1f-4c15-aed6-c3591b7b9b7c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:54.939895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53375d-7c1f-4c15-aed6-c3591b7b9b7c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:54.944996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48788f-01ef-42cb-b385-afc033daadb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:54.946005 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48788f-01ef-42cb-b385-afc033daadb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.946349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48788f-01ef-42cb-b385-afc033daadb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.946658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48788f-01ef-42cb-b385-afc033daadb6 admin admin] PATH_INFO: `/v3/projects/075405c93bfe4a9babc40a9872582f1b/users/dae1b54f686745e8aa7585261074f14a/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:54.962252 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48788f-01ef-42cb-b385-afc033daadb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075405c93bfe4a9babc40a9872582f1b, user_id=dae1b54f686745e8aa7585261074f14a, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:54.965011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48788f-01ef-42cb-b385-afc033daadb6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:54.978782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1186/2372] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:52:54 2022] PUT /identity/v3/projects/075405c93bfe4a9babc40a9872582f1b/users/dae1b54f686745e8aa7585261074f14a/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:52:54.990043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c7e9-dbd7-40e5-bf6d-77163106cbeb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:54.990523 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c7e9-dbd7-40e5-bf6d-77163106cbeb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:54.990943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625c7e9-dbd7-40e5-bf6d-77163106cbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.018517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c625c7e9-dbd7-40e5-bf6d-77163106cbeb None None] MFA Rules not processed for user `dae1b54f686745e8aa7585261074f14a`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:55.019691 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c625c7e9-dbd7-40e5-bf6d-77163106cbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:55.080065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1187/2373] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:52:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:52:55.084447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48788f-01ef-42cb-b385-afc033daadb6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:55.143279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48788f-01ef-42cb-b385-afc033daadb6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:55.147943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54373d29-813d-406c-ba8b-c4c320c70453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:55.148591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54373d29-813d-406c-ba8b-c4c320c70453 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:55.148874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54373d29-813d-406c-ba8b-c4c320c70453 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:55.149151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54373d29-813d-406c-ba8b-c4c320c70453 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.149859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54373d29-813d-406c-ba8b-c4c320c70453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:55.151780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54373d29-813d-406c-ba8b-c4c320c70453 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:55.176939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1187/2374] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:52:55 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:52:55.180940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625c7e9-dbd7-40e5-bf6d-77163106cbeb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:55.191786 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625c7e9-dbd7-40e5-bf6d-77163106cbeb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:55.248037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6cbef-94f0-4ae2-8b70-a3faf58cd7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:55.248738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6cbef-94f0-4ae2-8b70-a3faf58cd7ab admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:55.249024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6cbef-94f0-4ae2-8b70-a3faf58cd7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:55.249302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6cbef-94f0-4ae2-8b70-a3faf58cd7ab admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.250108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6cbef-94f0-4ae2-8b70-a3faf58cd7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:55.252071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6cbef-94f0-4ae2-8b70-a3faf58cd7ab admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:55.273479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1188/2375] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:52:55 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:52:55.275773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54373d29-813d-406c-ba8b-c4c320c70453 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:55.286687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54373d29-813d-406c-ba8b-c4c320c70453 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:55.291495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75306dd5-6015-4df1-8fbf-d90b55700761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:55.292328 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75306dd5-6015-4df1-8fbf-d90b55700761 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:55.292608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75306dd5-6015-4df1-8fbf-d90b55700761 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:55.292883 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75306dd5-6015-4df1-8fbf-d90b55700761 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.293621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75306dd5-6015-4df1-8fbf-d90b55700761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:55.295217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75306dd5-6015-4df1-8fbf-d90b55700761 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:55.306675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1188/2376] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:52:55.310745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6cbef-94f0-4ae2-8b70-a3faf58cd7ab admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:55.320609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6cbef-94f0-4ae2-8b70-a3faf58cd7ab admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:55.325455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d44b12-a102-49d4-9a38-e5d2529ea782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:55.326333 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d44b12-a102-49d4-9a38-e5d2529ea782 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:55.326615 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d44b12-a102-49d4-9a38-e5d2529ea782 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:55.326891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d44b12-a102-49d4-9a38-e5d2529ea782 admin admin] PATH_INFO: `/v3/projects/a0da8c0e6ed143e8934640d5e3f9fb5e/users/055b3b37cd364cdbbec6a3b333e21ad0/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.341502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d44b12-a102-49d4-9a38-e5d2529ea782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0da8c0e6ed143e8934640d5e3f9fb5e, user_id=055b3b37cd364cdbbec6a3b333e21ad0, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:55.345008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d44b12-a102-49d4-9a38-e5d2529ea782 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:55.357922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1189/2377] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:52:55 2022] PUT /identity/v3/projects/a0da8c0e6ed143e8934640d5e3f9fb5e/users/055b3b37cd364cdbbec6a3b333e21ad0/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:52:55.363035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75306dd5-6015-4df1-8fbf-d90b55700761 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:55.372940 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75306dd5-6015-4df1-8fbf-d90b55700761 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:55.440452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb339b63-1b44-40b6-9a3a-345ac307c732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:55.441124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb339b63-1b44-40b6-9a3a-345ac307c732 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:55.441408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb339b63-1b44-40b6-9a3a-345ac307c732 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:55.441691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb339b63-1b44-40b6-9a3a-345ac307c732 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.442434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb339b63-1b44-40b6-9a3a-345ac307c732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:55.444149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb339b63-1b44-40b6-9a3a-345ac307c732 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:55.458686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1189/2378] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:52:55.459621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d44b12-a102-49d4-9a38-e5d2529ea782 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:55.470762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d44b12-a102-49d4-9a38-e5d2529ea782 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:55.475630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a55c9a-414e-4e16-8fc0-72f68bfd612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:55.476602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a55c9a-414e-4e16-8fc0-72f68bfd612b admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:55.477080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a55c9a-414e-4e16-8fc0-72f68bfd612b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:55.477426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a55c9a-414e-4e16-8fc0-72f68bfd612b admin admin] PATH_INFO: `/v3/projects/a0da8c0e6ed143e8934640d5e3f9fb5e/users/055b3b37cd364cdbbec6a3b333e21ad0/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.479541 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a55c9a-414e-4e16-8fc0-72f68bfd612b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0da8c0e6ed143e8934640d5e3f9fb5e, user_id=055b3b37cd364cdbbec6a3b333e21ad0, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:55.482298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a55c9a-414e-4e16-8fc0-72f68bfd612b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:55.492888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1190/2379] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:52:55 2022] PUT /identity/v3/projects/a0da8c0e6ed143e8934640d5e3f9fb5e/users/055b3b37cd364cdbbec6a3b333e21ad0/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:52:55.503603 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe3de6-7d25-4ab7-9544-58346bee1560 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:55.503904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe3de6-7d25-4ab7-9544-58346bee1560 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:55.504185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe3de6-7d25-4ab7-9544-58346bee1560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.530376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-79fe3de6-7d25-4ab7-9544-58346bee1560 None None] MFA Rules not processed for user `055b3b37cd364cdbbec6a3b333e21ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:52:55.532391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-79fe3de6-7d25-4ab7-9544-58346bee1560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:55.599121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1190/2380] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:52:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:52:55.609665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a55c9a-414e-4e16-8fc0-72f68bfd612b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:55.611743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e7a55c9a-414e-4e16-8fc0-72f68bfd612b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:52:55.692271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a55c9a-414e-4e16-8fc0-72f68bfd612b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:55.696162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc137a-7987-47c9-8a0a-2e56dec436f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:55.696815 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc137a-7987-47c9-8a0a-2e56dec436f9 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:55.697110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc137a-7987-47c9-8a0a-2e56dec436f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:55.697393 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc137a-7987-47c9-8a0a-2e56dec436f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.707496 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc137a-7987-47c9-8a0a-2e56dec436f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:55.708980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc137a-7987-47c9-8a0a-2e56dec436f9 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:55.720343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1191/2381] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:52:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:52:55.799903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe3de6-7d25-4ab7-9544-58346bee1560 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:52:55.809116 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe3de6-7d25-4ab7-9544-58346bee1560 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:52:55.813487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43277c4-f300-4950-a654-cb7adcce3011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:52:55.814124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43277c4-f300-4950-a654-cb7adcce3011 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:52:55.814401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43277c4-f300-4950-a654-cb7adcce3011 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:52:55.814680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43277c4-f300-4950-a654-cb7adcce3011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:52:55.870406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43277c4-f300-4950-a654-cb7adcce3011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:52:55.871871 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43277c4-f300-4950-a654-cb7adcce3011 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:52:55.881163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1191/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:52:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:08.225321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc137a-7987-47c9-8a0a-2e56dec436f9 service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:08.226940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5fcc137a-7987-47c9-8a0a-2e56dec436f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:08.285376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc137a-7987-47c9-8a0a-2e56dec436f9 service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:08.289306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ee8ec-76f9-43e0-96de-f93667736439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:08.289959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ee8ec-76f9-43e0-96de-f93667736439 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:08.290244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ee8ec-76f9-43e0-96de-f93667736439 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:08.290524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ee8ec-76f9-43e0-96de-f93667736439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:08.292515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-db5ee8ec-76f9-43e0-96de-f93667736439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:08.358139 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ee8ec-76f9-43e0-96de-f93667736439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:08.361004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ee8ec-76f9-43e0-96de-f93667736439 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:08.379865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1192/2383] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:41.411890 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43277c4-f300-4950-a654-cb7adcce3011 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:41.476508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43277c4-f300-4950-a654-cb7adcce3011 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:41.481384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:41.482858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:41.483139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:41.483413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] PATH_INFO: `/v3/users/dae1b54f686745e8aa7585261074f14a` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:41.484651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae1b54f686745e8aa7585261074f14a)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:41.486564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:41.531229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae1b54f686745e8aa7585261074f14a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:41.537949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae1b54f686745e8aa7585261074f14a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:41.550556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae1b54f686745e8aa7585261074f14a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:41.557648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae1b54f686745e8aa7585261074f14a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:41.558263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae1b54f686745e8aa7585261074f14a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:41.564271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1192/2384] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:53:41 2022] DELETE /identity/v3/users/dae1b54f686745e8aa7585261074f14a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:41.568805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb88f7-12a1-4c8d-8085-7025a63d8970 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:41.569315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb88f7-12a1-4c8d-8085-7025a63d8970 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:41.569420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb88f7-12a1-4c8d-8085-7025a63d8970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:41.586714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-11eb88f7-12a1-4c8d-8085-7025a63d8970 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:41.587969 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-11eb88f7-12a1-4c8d-8085-7025a63d8970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:41.645164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1193/2385] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:41.655391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:41.656870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:41.711130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90473eb-e33b-4035-885e-7c264647d4ca admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:41.714668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e4fd1-e29f-46c8-aba1-016a3266e8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:41.715306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e4fd1-e29f-46c8-aba1-016a3266e8ab service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:41.715615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e4fd1-e29f-46c8-aba1-016a3266e8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:41.715904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e4fd1-e29f-46c8-aba1-016a3266e8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:41.724767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e4fd1-e29f-46c8-aba1-016a3266e8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:41.726190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e4fd1-e29f-46c8-aba1-016a3266e8ab service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:41.735431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1193/2386] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:41.991025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb88f7-12a1-4c8d-8085-7025a63d8970 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:41.992643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-11eb88f7-12a1-4c8d-8085-7025a63d8970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:42.005694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb88f7-12a1-4c8d-8085-7025a63d8970 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:42.010439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:42.011387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:42.011765 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:42.012108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] PATH_INFO: `/v3/projects/075405c93bfe4a9babc40a9872582f1b` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:42.013487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=075405c93bfe4a9babc40a9872582f1b)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:42.015516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:42.060970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075405c93bfe4a9babc40a9872582f1b', 'request_id': 'req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.067871 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075405c93bfe4a9babc40a9872582f1b', 'request_id': 'req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.073783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075405c93bfe4a9babc40a9872582f1b', 'request_id': 'req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.084488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] The token cache is being invalidate because project 075405c93bfe4a9babc40a9872582f1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:53:42.084777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.085400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.086905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1194/2387] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:53:41 2022] DELETE /identity/v3/projects/075405c93bfe4a9babc40a9872582f1b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:42.091130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e4fd1-e29f-46c8-aba1-016a3266e8ab service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:42.101519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e4fd1-e29f-46c8-aba1-016a3266e8ab service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:42.155150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:42.156041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:42.156330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:42.156609 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] PATH_INFO: `/v3/users/055b3b37cd364cdbbec6a3b333e21ad0` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:42.157818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055b3b37cd364cdbbec6a3b333e21ad0)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:42.159774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:42.203489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055b3b37cd364cdbbec6a3b333e21ad0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.210007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055b3b37cd364cdbbec6a3b333e21ad0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.221110 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055b3b37cd364cdbbec6a3b333e21ad0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.227934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055b3b37cd364cdbbec6a3b333e21ad0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.228554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c246c4e-f111-4138-8a49-6a6c73f6fdd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055b3b37cd364cdbbec6a3b333e21ad0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.235025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1194/2388] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:53:42 2022] DELETE /identity/v3/users/055b3b37cd364cdbbec6a3b333e21ad0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:42.511390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:42.514516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:42.530606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7cab9-48b6-4d4c-b8c5-cb11d99bfdaa admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:42.585644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:42.586500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:42.586783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:42.587059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] PATH_INFO: `/v3/projects/a0da8c0e6ed143e8934640d5e3f9fb5e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:42.588252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0da8c0e6ed143e8934640d5e3f9fb5e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:42.590171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:42.635199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0da8c0e6ed143e8934640d5e3f9fb5e', 'request_id': 'req-21c0625f-2bee-49c9-8f37-70089a334ceb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.641938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0da8c0e6ed143e8934640d5e3f9fb5e', 'request_id': 'req-21c0625f-2bee-49c9-8f37-70089a334ceb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.648738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0da8c0e6ed143e8934640d5e3f9fb5e', 'request_id': 'req-21c0625f-2bee-49c9-8f37-70089a334ceb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.660059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] The token cache is being invalidate because project a0da8c0e6ed143e8934640d5e3f9fb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:53:42.660353 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.661041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-21c0625f-2bee-49c9-8f37-70089a334ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:42.662570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1195/2389] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:53:42 2022] DELETE /identity/v3/projects/a0da8c0e6ed143e8934640d5e3f9fb5e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:42.668285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229e7c8-46d6-4676-866b-423fd05b2c09 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:42.668785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229e7c8-46d6-4676-866b-423fd05b2c09 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:42.668969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229e7c8-46d6-4676-866b-423fd05b2c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:42.688346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e229e7c8-46d6-4676-866b-423fd05b2c09 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:42.689556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e229e7c8-46d6-4676-866b-423fd05b2c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:42.749116 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1195/2390] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:42.757004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6cd6e-da48-44f9-af56-b43f1fdcd848 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:42.757324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6cd6e-da48-44f9-af56-b43f1fdcd848 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:42.757608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6cd6e-da48-44f9-af56-b43f1fdcd848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:42.776631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-73e6cd6e-da48-44f9-af56-b43f1fdcd848 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:42.777825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-73e6cd6e-da48-44f9-af56-b43f1fdcd848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:42.786224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1196/2391] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:42.790318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229e7c8-46d6-4676-866b-423fd05b2c09 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:42.799737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229e7c8-46d6-4676-866b-423fd05b2c09 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:42.804274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e97409-5ea4-4664-9551-aefd27cc820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:42.804921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e97409-5ea4-4664-9551-aefd27cc820a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:42.805207 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e97409-5ea4-4664-9551-aefd27cc820a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:42.805485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e97409-5ea4-4664-9551-aefd27cc820a admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:42.806221 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e97409-5ea4-4664-9551-aefd27cc820a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:53:42.806530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e97409-5ea4-4664-9551-aefd27cc820a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:42.808151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e97409-5ea4-4664-9551-aefd27cc820a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:42.819658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1196/2392] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:53:42.824160 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6cd6e-da48-44f9-af56-b43f1fdcd848 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:42.833745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6cd6e-da48-44f9-af56-b43f1fdcd848 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:42.838376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b50fa7-97f1-4ec9-a63d-7090bc05695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:42.839022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b50fa7-97f1-4ec9-a63d-7090bc05695e admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:42.839309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b50fa7-97f1-4ec9-a63d-7090bc05695e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:42.839621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b50fa7-97f1-4ec9-a63d-7090bc05695e admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:42.840334 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b50fa7-97f1-4ec9-a63d-7090bc05695e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:42.842963 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b50fa7-97f1-4ec9-a63d-7090bc05695e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:42.867506 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1197/2393] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:53:42 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:53:42.871546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e97409-5ea4-4664-9551-aefd27cc820a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:42.881568 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e97409-5ea4-4664-9551-aefd27cc820a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:42.936873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0391af-2e45-4d6a-b0c1-6ba1538bd623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:42.937539 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0391af-2e45-4d6a-b0c1-6ba1538bd623 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:42.937821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0391af-2e45-4d6a-b0c1-6ba1538bd623 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:42.938096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0391af-2e45-4d6a-b0c1-6ba1538bd623 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:42.938807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0391af-2e45-4d6a-b0c1-6ba1538bd623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:42.940756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0391af-2e45-4d6a-b0c1-6ba1538bd623 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:42.958974 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1197/2394] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:53:42 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:53:42.963180 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b50fa7-97f1-4ec9-a63d-7090bc05695e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:42.973412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b50fa7-97f1-4ec9-a63d-7090bc05695e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:42.977962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e389e-1887-41ab-88c9-65926263223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:42.978608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e389e-1887-41ab-88c9-65926263223c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:42.978889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e389e-1887-41ab-88c9-65926263223c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:42.979163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e389e-1887-41ab-88c9-65926263223c admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:42.979925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e389e-1887-41ab-88c9-65926263223c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:42.982138 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e389e-1887-41ab-88c9-65926263223c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:42.992190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1198/2395] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:53:42.996094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0391af-2e45-4d6a-b0c1-6ba1538bd623 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.006671 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0391af-2e45-4d6a-b0c1-6ba1538bd623 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.011287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9607e0-30ad-4714-aca1-36b8740d7ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.012190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9607e0-30ad-4714-aca1-36b8740d7ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.012511 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9607e0-30ad-4714-aca1-36b8740d7ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.012791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9607e0-30ad-4714-aca1-36b8740d7ac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.013615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9607e0-30ad-4714-aca1-36b8740d7ac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.015202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9607e0-30ad-4714-aca1-36b8740d7ac5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.025480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1198/2396] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:53:43.029556 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e389e-1887-41ab-88c9-65926263223c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.039043 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e389e-1887-41ab-88c9-65926263223c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.043820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c3e7-466d-4a4c-bbfa-b77fae5a18a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.045211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c3e7-466d-4a4c-bbfa-b77fae5a18a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.045494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c3e7-466d-4a4c-bbfa-b77fae5a18a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.045771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c3e7-466d-4a4c-bbfa-b77fae5a18a1 admin admin] PATH_INFO: `/v3/projects/f1a5b57e9ee74505acbd48ed766d23f2/users/617782fd37324d2fb2bc80a89dd70447/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.060076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c3e7-466d-4a4c-bbfa-b77fae5a18a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a5b57e9ee74505acbd48ed766d23f2, user_id=617782fd37324d2fb2bc80a89dd70447, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.062726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c3e7-466d-4a4c-bbfa-b77fae5a18a1 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.076169 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1199/2397] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:53:43 2022] PUT /identity/v3/projects/f1a5b57e9ee74505acbd48ed766d23f2/users/617782fd37324d2fb2bc80a89dd70447/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:43.086276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4da9e-d8d3-4598-aa90-3b0c58e507c7 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.086571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4da9e-d8d3-4598-aa90-3b0c58e507c7 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.086853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4da9e-d8d3-4598-aa90-3b0c58e507c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.113921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2ec4da9e-d8d3-4598-aa90-3b0c58e507c7 None None] MFA Rules not processed for user `617782fd37324d2fb2bc80a89dd70447`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:43.115172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2ec4da9e-d8d3-4598-aa90-3b0c58e507c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:43.176864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1199/2398] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:43.181338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c3e7-466d-4a4c-bbfa-b77fae5a18a1 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.239647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c3e7-466d-4a4c-bbfa-b77fae5a18a1 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.244280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f09643-c9a1-40a8-a81a-f26d24aabe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.244931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f09643-c9a1-40a8-a81a-f26d24aabe63 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.245217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f09643-c9a1-40a8-a81a-f26d24aabe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.245495 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f09643-c9a1-40a8-a81a-f26d24aabe63 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.246201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f09643-c9a1-40a8-a81a-f26d24aabe63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.248197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f09643-c9a1-40a8-a81a-f26d24aabe63 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.272431 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1200/2399] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:53:43 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:53:43.276382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4da9e-d8d3-4598-aa90-3b0c58e507c7 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.287132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4da9e-d8d3-4598-aa90-3b0c58e507c7 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.340199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b9b29-d2bf-49e0-a47b-0085cd63cba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.340881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b9b29-d2bf-49e0-a47b-0085cd63cba8 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.341170 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b9b29-d2bf-49e0-a47b-0085cd63cba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.341449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b9b29-d2bf-49e0-a47b-0085cd63cba8 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.342172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b9b29-d2bf-49e0-a47b-0085cd63cba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.344119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b9b29-d2bf-49e0-a47b-0085cd63cba8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.362754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1200/2400] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:53:43 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:53:43.366678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f09643-c9a1-40a8-a81a-f26d24aabe63 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.377335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f09643-c9a1-40a8-a81a-f26d24aabe63 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.381865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c9623-74e9-4779-a56a-06ac3ead4f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.382513 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c9623-74e9-4779-a56a-06ac3ead4f5c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.382795 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c9623-74e9-4779-a56a-06ac3ead4f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.383071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c9623-74e9-4779-a56a-06ac3ead4f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.383828 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c9623-74e9-4779-a56a-06ac3ead4f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.385411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c9623-74e9-4779-a56a-06ac3ead4f5c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.396645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1201/2401] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:53:43.400497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b9b29-d2bf-49e0-a47b-0085cd63cba8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.410352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b9b29-d2bf-49e0-a47b-0085cd63cba8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.414906 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d22a24-d3f3-434f-98c0-f1ddf0715f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.415576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d22a24-d3f3-434f-98c0-f1ddf0715f33 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.415869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d22a24-d3f3-434f-98c0-f1ddf0715f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.416147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d22a24-d3f3-434f-98c0-f1ddf0715f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.416885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d22a24-d3f3-434f-98c0-f1ddf0715f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.418477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d22a24-d3f3-434f-98c0-f1ddf0715f33 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.428679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1201/2402] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:53:43.432690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c9623-74e9-4779-a56a-06ac3ead4f5c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.442563 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c9623-74e9-4779-a56a-06ac3ead4f5c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.447025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373847e-2fa7-4db0-a318-20c26a6b3673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.447929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373847e-2fa7-4db0-a318-20c26a6b3673 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.448213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373847e-2fa7-4db0-a318-20c26a6b3673 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.448486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373847e-2fa7-4db0-a318-20c26a6b3673 admin admin] PATH_INFO: `/v3/projects/fb8669730dec4023bad45b857762ef51/users/43a4d94379e3455bbb31ae965d9320e6/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.463010 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373847e-2fa7-4db0-a318-20c26a6b3673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8669730dec4023bad45b857762ef51, user_id=43a4d94379e3455bbb31ae965d9320e6, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.465668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373847e-2fa7-4db0-a318-20c26a6b3673 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.478674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1202/2403] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:53:43 2022] PUT /identity/v3/projects/fb8669730dec4023bad45b857762ef51/users/43a4d94379e3455bbb31ae965d9320e6/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:43.489814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b16e-ffa9-493e-a390-2a701b7f253e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.490106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b16e-ffa9-493e-a390-2a701b7f253e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.490389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b16e-ffa9-493e-a390-2a701b7f253e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.518829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8b77b16e-ffa9-493e-a390-2a701b7f253e None None] MFA Rules not processed for user `43a4d94379e3455bbb31ae965d9320e6`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:43.520081 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8b77b16e-ffa9-493e-a390-2a701b7f253e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:43.583507 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1202/2404] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:43.588238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373847e-2fa7-4db0-a318-20c26a6b3673 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.656902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373847e-2fa7-4db0-a318-20c26a6b3673 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.661623 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b80ddd-f499-4ad2-acd3-6b14eef9dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.662277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b80ddd-f499-4ad2-acd3-6b14eef9dfda admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.662560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b80ddd-f499-4ad2-acd3-6b14eef9dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.662836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b80ddd-f499-4ad2-acd3-6b14eef9dfda admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.663547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b80ddd-f499-4ad2-acd3-6b14eef9dfda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.665471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b80ddd-f499-4ad2-acd3-6b14eef9dfda admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.690952 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1203/2405] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:53:43 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:53:43.694917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77b16e-ffa9-493e-a390-2a701b7f253e None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.705422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77b16e-ffa9-493e-a390-2a701b7f253e None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.759841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c87372-c8e3-49bc-88da-281d6fd9b53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.760569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c87372-c8e3-49bc-88da-281d6fd9b53b admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.760879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c87372-c8e3-49bc-88da-281d6fd9b53b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.761159 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c87372-c8e3-49bc-88da-281d6fd9b53b admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.761909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c87372-c8e3-49bc-88da-281d6fd9b53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.763930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c87372-c8e3-49bc-88da-281d6fd9b53b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.785057 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1203/2406] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:53:43 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:53:43.789354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b80ddd-f499-4ad2-acd3-6b14eef9dfda admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.800416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b80ddd-f499-4ad2-acd3-6b14eef9dfda admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.805152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d711fb-157f-4a44-9c71-d0ea84919507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.805816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d711fb-157f-4a44-9c71-d0ea84919507 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.806100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d711fb-157f-4a44-9c71-d0ea84919507 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.806378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d711fb-157f-4a44-9c71-d0ea84919507 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.807123 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d711fb-157f-4a44-9c71-d0ea84919507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.808755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d711fb-157f-4a44-9c71-d0ea84919507 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.819462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1204/2407] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:53:43.824142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c87372-c8e3-49bc-88da-281d6fd9b53b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.835053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c87372-c8e3-49bc-88da-281d6fd9b53b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.840182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef42931-863d-462b-8b56-20b6a5386645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.841782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef42931-863d-462b-8b56-20b6a5386645 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.842493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef42931-863d-462b-8b56-20b6a5386645 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.842785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef42931-863d-462b-8b56-20b6a5386645 admin admin] PATH_INFO: `/v3/projects/cdaa0e5cf3a447f4a3022d79d280de9a/users/2a18bce62a7348218a5ac35f1ceebd77/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.858756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef42931-863d-462b-8b56-20b6a5386645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdaa0e5cf3a447f4a3022d79d280de9a, user_id=2a18bce62a7348218a5ac35f1ceebd77, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.861451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef42931-863d-462b-8b56-20b6a5386645 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.873576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1204/2408] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:53:43 2022] PUT /identity/v3/projects/cdaa0e5cf3a447f4a3022d79d280de9a/users/2a18bce62a7348218a5ac35f1ceebd77/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:43.877690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d711fb-157f-4a44-9c71-d0ea84919507 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.887440 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d711fb-157f-4a44-9c71-d0ea84919507 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.943111 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0f28b-4163-4957-8a1f-a65c168d2754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.943801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0f28b-4163-4957-8a1f-a65c168d2754 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.944090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0f28b-4163-4957-8a1f-a65c168d2754 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.944367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0f28b-4163-4957-8a1f-a65c168d2754 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.945102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0f28b-4163-4957-8a1f-a65c168d2754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.946690 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0f28b-4163-4957-8a1f-a65c168d2754 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.956113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1205/2409] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:53:43.960239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef42931-863d-462b-8b56-20b6a5386645 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:43.970848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef42931-863d-462b-8b56-20b6a5386645 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:43.975424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488ce5-5110-49a8-aaba-2b75fe5a50ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:43.976370 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488ce5-5110-49a8-aaba-2b75fe5a50ff admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:43.976655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488ce5-5110-49a8-aaba-2b75fe5a50ff admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:43.976936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3488ce5-5110-49a8-aaba-2b75fe5a50ff admin admin] PATH_INFO: `/v3/projects/cdaa0e5cf3a447f4a3022d79d280de9a/users/2a18bce62a7348218a5ac35f1ceebd77/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:43.978980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488ce5-5110-49a8-aaba-2b75fe5a50ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdaa0e5cf3a447f4a3022d79d280de9a, user_id=2a18bce62a7348218a5ac35f1ceebd77, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:43.982419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3488ce5-5110-49a8-aaba-2b75fe5a50ff admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:43.992321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1205/2410] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:53:43 2022] PUT /identity/v3/projects/cdaa0e5cf3a447f4a3022d79d280de9a/users/2a18bce62a7348218a5ac35f1ceebd77/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:44.002372 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62643ecd-6b8d-4b28-a484-c35d67ce4a4e None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:44.002667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62643ecd-6b8d-4b28-a484-c35d67ce4a4e None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:44.002954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62643ecd-6b8d-4b28-a484-c35d67ce4a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:44.030179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-62643ecd-6b8d-4b28-a484-c35d67ce4a4e None None] MFA Rules not processed for user `2a18bce62a7348218a5ac35f1ceebd77`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:44.031439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-62643ecd-6b8d-4b28-a484-c35d67ce4a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:44.096133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1206/2411] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:44.105425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488ce5-5110-49a8-aaba-2b75fe5a50ff admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:44.107496 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c3488ce5-5110-49a8-aaba-2b75fe5a50ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:44.162217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3488ce5-5110-49a8-aaba-2b75fe5a50ff admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:44.165850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9ffa9-185b-4a8d-946f-a015427f53e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:44.166500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9ffa9-185b-4a8d-946f-a015427f53e2 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:44.166787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9ffa9-185b-4a8d-946f-a015427f53e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:44.167069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9ffa9-185b-4a8d-946f-a015427f53e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:44.176521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9ffa9-185b-4a8d-946f-a015427f53e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:44.177950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9ffa9-185b-4a8d-946f-a015427f53e2 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:44.188314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1206/2412] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:44.473009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62643ecd-6b8d-4b28-a484-c35d67ce4a4e None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:44.474403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-62643ecd-6b8d-4b28-a484-c35d67ce4a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:44.486990 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62643ecd-6b8d-4b28-a484-c35d67ce4a4e None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:44.490584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:44.491236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:44.491522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:44.491831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:44.493591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:44.569621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:44.571166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:44.582803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1207/2413] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:44.649038 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9ffa9-185b-4a8d-946f-a015427f53e2 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:44.658171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9ffa9-185b-4a8d-946f-a015427f53e2 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:44.661976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f2a4f-b917-4a06-9227-2f5f6adb55fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:44.662619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f2a4f-b917-4a06-9227-2f5f6adb55fe service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:44.662901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f2a4f-b917-4a06-9227-2f5f6adb55fe service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:44.663179 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f2a4f-b917-4a06-9227-2f5f6adb55fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:44.739579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f2a4f-b917-4a06-9227-2f5f6adb55fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:44.742026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f2a4f-b917-4a06-9227-2f5f6adb55fe service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:44.757480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1207/2414] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:45.221826 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:45.223317 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:45.288591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2a5e9-4a5b-4191-9543-43d177620097 service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:45.293230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:45.294134 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:45.294383 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:45.294658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] PATH_INFO: `/v3/users/7f0c0ea1e431437880ed43ef1c9cb1bb` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:45.295874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f0c0ea1e431437880ed43ef1c9cb1bb)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:45.297768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:45.345606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f0c0ea1e431437880ed43ef1c9cb1bb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.353169 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f0c0ea1e431437880ed43ef1c9cb1bb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.353974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f0c0ea1e431437880ed43ef1c9cb1bb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.365474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f0c0ea1e431437880ed43ef1c9cb1bb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.373011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f0c0ea1e431437880ed43ef1c9cb1bb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.378765 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1208/2415] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:53:45 2022] DELETE /identity/v3/users/7f0c0ea1e431437880ed43ef1c9cb1bb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:45.553962 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f2a4f-b917-4a06-9227-2f5f6adb55fe service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:45.565960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f2a4f-b917-4a06-9227-2f5f6adb55fe service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:45.621206 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:45.622131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:45.622415 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:45.622696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] PATH_INFO: `/v3/projects/5f4ae6dda115477db147059df89ad002` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:45.623946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4ae6dda115477db147059df89ad002)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:45.625844 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:45.670586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4ae6dda115477db147059df89ad002', 'request_id': 'req-9b6b00c5-1e2a-40ec-b78d-13705121de9a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.676491 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4ae6dda115477db147059df89ad002', 'request_id': 'req-9b6b00c5-1e2a-40ec-b78d-13705121de9a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.681565 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4ae6dda115477db147059df89ad002', 'request_id': 'req-9b6b00c5-1e2a-40ec-b78d-13705121de9a'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.693217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] The token cache is being invalidate because project 5f4ae6dda115477db147059df89ad002 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:53:45.693508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.694126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:45.695678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1208/2416] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:53:45 2022] DELETE /identity/v3/projects/5f4ae6dda115477db147059df89ad002 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:47.213323 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:47.214805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:47.273414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa23edf-a001-432d-bd12-985469fa4b4a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:47.320811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:47.321474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:47.321747 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:47.322031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:47.323862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:47.394598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:47.396179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:47.407167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1209/2417] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:48.773590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:48.775385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:48.837568 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b00c5-1e2a-40ec-b78d-13705121de9a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:48.841545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5689329-89bc-42f0-ae5d-85d911b156d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:48.842197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5689329-89bc-42f0-ae5d-85d911b156d9 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:48.842482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5689329-89bc-42f0-ae5d-85d911b156d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:48.842760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5689329-89bc-42f0-ae5d-85d911b156d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:48.844611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a5689329-89bc-42f0-ae5d-85d911b156d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:48.920408 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5689329-89bc-42f0-ae5d-85d911b156d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:48.923242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5689329-89bc-42f0-ae5d-85d911b156d9 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:48.936812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1209/2418] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:51.118474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:51.122856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:51.197025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c5701-b292-4e76-8981-098fa835f3d0 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:51.202595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:51.203481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:51.203794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:51.204267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] PATH_INFO: `/v3/users/617782fd37324d2fb2bc80a89dd70447` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:51.205659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617782fd37324d2fb2bc80a89dd70447)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:51.207793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:51.256789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617782fd37324d2fb2bc80a89dd70447'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.266221 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617782fd37324d2fb2bc80a89dd70447'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.267288 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617782fd37324d2fb2bc80a89dd70447'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.284320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617782fd37324d2fb2bc80a89dd70447'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.292970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617782fd37324d2fb2bc80a89dd70447'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.300471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1210/2419] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:53:51 2022] DELETE /identity/v3/users/617782fd37324d2fb2bc80a89dd70447 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:53:51.305182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0229b9-9f86-422b-ad91-a2c376708d4d None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:51.306010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0229b9-9f86-422b-ad91-a2c376708d4d None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:51.306462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0229b9-9f86-422b-ad91-a2c376708d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:51.326301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2a0229b9-9f86-422b-ad91-a2c376708d4d None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:51.328050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2a0229b9-9f86-422b-ad91-a2c376708d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:51.395154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1210/2420] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:51.406804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:51.408932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:51.478447 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1199567f-a763-477e-b4bb-f2a3238c2469 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:51.483051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02255e-b2bb-4364-bc1d-d64139f8c342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:51.483765 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02255e-b2bb-4364-bc1d-d64139f8c342 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:51.484056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02255e-b2bb-4364-bc1d-d64139f8c342 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:51.484328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02255e-b2bb-4364-bc1d-d64139f8c342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:51.495709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02255e-b2bb-4364-bc1d-d64139f8c342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:51.500451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02255e-b2bb-4364-bc1d-d64139f8c342 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:51.509657 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1211/2421] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:51.821977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0229b9-9f86-422b-ad91-a2c376708d4d None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:51.823944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2a0229b9-9f86-422b-ad91-a2c376708d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:51.842054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0229b9-9f86-422b-ad91-a2c376708d4d None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:51.849520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:51.850256 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:51.850645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:51.851114 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] PATH_INFO: `/v3/projects/f1a5b57e9ee74505acbd48ed766d23f2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:51.852624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a5b57e9ee74505acbd48ed766d23f2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:51.855334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:51.921051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a5b57e9ee74505acbd48ed766d23f2', 'request_id': 'req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.929034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a5b57e9ee74505acbd48ed766d23f2', 'request_id': 'req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.935879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a5b57e9ee74505acbd48ed766d23f2', 'request_id': 'req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.953572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] The token cache is being invalidate because project f1a5b57e9ee74505acbd48ed766d23f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:53:51.953872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.955239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02cb7fef-c8a8-4a91-bf9a-8afd9ad627da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:51.960480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1211/2422] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:53:51 2022] DELETE /identity/v3/projects/f1a5b57e9ee74505acbd48ed766d23f2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:51.961999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02255e-b2bb-4364-bc1d-d64139f8c342 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:51.973042 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02255e-b2bb-4364-bc1d-d64139f8c342 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:52.061767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:52.062874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:52.063109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:52.063387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] PATH_INFO: `/v3/users/43a4d94379e3455bbb31ae965d9320e6` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:52.064715 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=43a4d94379e3455bbb31ae965d9320e6)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:52.067032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:52.103999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c669583-b56d-496b-ab48-f5f1da0252e0 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:52.104389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c669583-b56d-496b-ab48-f5f1da0252e0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:52.104824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c669583-b56d-496b-ab48-f5f1da0252e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:52.126242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43a4d94379e3455bbb31ae965d9320e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.128376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-0c669583-b56d-496b-ab48-f5f1da0252e0 None None] MFA Rules not processed for user `dd2a59a36a2e422795e977c7af5004e6`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:52.130017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0c669583-b56d-496b-ab48-f5f1da0252e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:52.133585 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43a4d94379e3455bbb31ae965d9320e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.134335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43a4d94379e3455bbb31ae965d9320e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.149644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43a4d94379e3455bbb31ae965d9320e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.160040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43a4d94379e3455bbb31ae965d9320e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.173648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1212/2423] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:53:51 2022] DELETE /identity/v3/users/43a4d94379e3455bbb31ae965d9320e6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:52.214748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1212/2424] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:52.605588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:52.607282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:52.646965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c669583-b56d-496b-ab48-f5f1da0252e0 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:52.648593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0c669583-b56d-496b-ab48-f5f1da0252e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:52.662765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c669583-b56d-496b-ab48-f5f1da0252e0 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:52.686485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd095d-50d0-41a5-8bd6-85f78cf08bcc admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:52.692587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3569793-1416-4879-9c88-547c8a89d8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:52.693014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3569793-1416-4879-9c88-547c8a89d8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:52.693223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3569793-1416-4879-9c88-547c8a89d8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:52.693531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3569793-1416-4879-9c88-547c8a89d8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:52.696140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d3569793-1416-4879-9c88-547c8a89d8d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:52.707848 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3569793-1416-4879-9c88-547c8a89d8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:52.709614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3569793-1416-4879-9c88-547c8a89d8d5 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:52.724902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:52.725770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:52.726055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:52.726336 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] PATH_INFO: `/v3/projects/fb8669730dec4023bad45b857762ef51` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:52.727649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8669730dec4023bad45b857762ef51)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:52.727825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1213/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:52.729641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:52.784336 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8669730dec4023bad45b857762ef51', 'request_id': 'req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.790227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8669730dec4023bad45b857762ef51', 'request_id': 'req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.795458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8669730dec4023bad45b857762ef51', 'request_id': 'req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.808135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] The token cache is being invalidate because project fb8669730dec4023bad45b857762ef51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:53:52.808428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.809594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5dfb36c9-ba56-4468-9374-bfdd8410c6e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.811254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1213/2426] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:53:52 2022] DELETE /identity/v3/projects/fb8669730dec4023bad45b857762ef51 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:53:52.815249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3569793-1416-4879-9c88-547c8a89d8d5 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:52.828277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3569793-1416-4879-9c88-547c8a89d8d5 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:52.891394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:52.892812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:52.893254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:52.893709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] PATH_INFO: `/v3/users/2a18bce62a7348218a5ac35f1ceebd77` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:52.895137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a18bce62a7348218a5ac35f1ceebd77)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:52.897433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:52.950224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a18bce62a7348218a5ac35f1ceebd77'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.956684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a18bce62a7348218a5ac35f1ceebd77'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.957356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a18bce62a7348218a5ac35f1ceebd77'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.969527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a18bce62a7348218a5ac35f1ceebd77'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.976889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-be85b3ba-b56e-45fa-8d1f-1828236e5a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a18bce62a7348218a5ac35f1ceebd77'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:52.983601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1214/2427] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:53:52 2022] DELETE /identity/v3/users/2a18bce62a7348218a5ac35f1ceebd77 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:53:53.060461 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84615d9-97ae-4474-b2a0-5cb29e2cb1a5 None None] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.061124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84615d9-97ae-4474-b2a0-5cb29e2cb1a5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.061485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84615d9-97ae-4474-b2a0-5cb29e2cb1a5 None None] PATH_INFO: `/` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.063475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1214/2428] 10.222.0.48 () {54 vars in 960 bytes} [Thu Jan 27 16:53:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jan 27 16:53:53.068842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158e8a9-816b-4343-8bab-fd1dbc022022 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.069608 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158e8a9-816b-4343-8bab-fd1dbc022022 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.069904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158e8a9-816b-4343-8bab-fd1dbc022022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.108363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-4158e8a9-816b-4343-8bab-fd1dbc022022 None None] MFA Rules not processed for user `6f5bbcf690d144ab99438b3f65b5e100`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:53.109684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4158e8a9-816b-4343-8bab-fd1dbc022022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:53.175074 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1215/2429] 10.222.0.48 () {58 vars in 1057 bytes} [Thu Jan 27 16:53:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:53.182623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84615d9-97ae-4474-b2a0-5cb29e2cb1a5 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:53.196168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84615d9-97ae-4474-b2a0-5cb29e2cb1a5 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:53.201654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f52299-a643-402d-b970-d040bd027b1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5bbcf690d144ab99438b3f65b5e100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:53.202296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52299-a643-402d-b970-d040bd027b1c service placement] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.202578 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52299-a643-402d-b970-d040bd027b1c service placement] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.202855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f52299-a643-402d-b970-d040bd027b1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.204649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e5f52299-a643-402d-b970-d040bd027b1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:53.217172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f52299-a643-402d-b970-d040bd027b1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:53.218906 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f52299-a643-402d-b970-d040bd027b1c service placement] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:53.231042 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1215/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:53:53.309534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158e8a9-816b-4343-8bab-fd1dbc022022 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:53.311235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4158e8a9-816b-4343-8bab-fd1dbc022022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:53.383286 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4158e8a9-816b-4343-8bab-fd1dbc022022 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:53.388567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:53.389249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.389601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.389763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] PATH_INFO: `/v3/projects/cdaa0e5cf3a447f4a3022d79d280de9a` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.391277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdaa0e5cf3a447f4a3022d79d280de9a)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:53.393520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:53.443612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdaa0e5cf3a447f4a3022d79d280de9a', 'request_id': 'req-33889253-1af4-40e9-8dad-5e7056bfbd13'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:53.451217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdaa0e5cf3a447f4a3022d79d280de9a', 'request_id': 'req-33889253-1af4-40e9-8dad-5e7056bfbd13'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:53.457682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdaa0e5cf3a447f4a3022d79d280de9a', 'request_id': 'req-33889253-1af4-40e9-8dad-5e7056bfbd13'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:53.468295 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] The token cache is being invalidate because project cdaa0e5cf3a447f4a3022d79d280de9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:53:53.468590 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:53.469238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33889253-1af4-40e9-8dad-5e7056bfbd13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:53.470896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1216/2431] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:53:53 2022] DELETE /identity/v3/projects/cdaa0e5cf3a447f4a3022d79d280de9a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:53.478225 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71ae0-bff2-4935-ac77-32288575c74f None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.478559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71ae0-bff2-4935-ac77-32288575c74f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.478856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c71ae0-bff2-4935-ac77-32288575c74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.500526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-14c71ae0-bff2-4935-ac77-32288575c74f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:53.501998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-14c71ae0-bff2-4935-ac77-32288575c74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:53.563695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1216/2432] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:53.573280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06175929-2b58-4ff9-af43-9bd5094e48b0 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.573591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06175929-2b58-4ff9-af43-9bd5094e48b0 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.573873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06175929-2b58-4ff9-af43-9bd5094e48b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.592809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-06175929-2b58-4ff9-af43-9bd5094e48b0 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:53.594016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-06175929-2b58-4ff9-af43-9bd5094e48b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:53.603115 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1217/2433] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:53.608158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c71ae0-bff2-4935-ac77-32288575c74f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:53.618220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c71ae0-bff2-4935-ac77-32288575c74f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:53.623268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48319799-c738-4c14-8907-4ee0a5f2f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:53.623978 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48319799-c738-4c14-8907-4ee0a5f2f63b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.624268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48319799-c738-4c14-8907-4ee0a5f2f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.624550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48319799-c738-4c14-8907-4ee0a5f2f63b admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.625295 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48319799-c738-4c14-8907-4ee0a5f2f63b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:53:53.625692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48319799-c738-4c14-8907-4ee0a5f2f63b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:53.627456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48319799-c738-4c14-8907-4ee0a5f2f63b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:53.643825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1217/2434] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:53:53.644988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06175929-2b58-4ff9-af43-9bd5094e48b0 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:53.654687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06175929-2b58-4ff9-af43-9bd5094e48b0 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:53.659317 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105973f-6f5b-4799-af86-eb662fe5229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:53.660009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105973f-6f5b-4799-af86-eb662fe5229e admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.660298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105973f-6f5b-4799-af86-eb662fe5229e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.660577 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9105973f-6f5b-4799-af86-eb662fe5229e admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.661299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105973f-6f5b-4799-af86-eb662fe5229e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:53.663260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9105973f-6f5b-4799-af86-eb662fe5229e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:53.691977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1218/2435] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:53:53 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:53:53.696052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48319799-c738-4c14-8907-4ee0a5f2f63b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:53.705941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48319799-c738-4c14-8907-4ee0a5f2f63b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:53.762329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8ce2f-6549-4e65-b4a6-f5c034480322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:53.763266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8ce2f-6549-4e65-b4a6-f5c034480322 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.763616 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8ce2f-6549-4e65-b4a6-f5c034480322 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.763911 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8ce2f-6549-4e65-b4a6-f5c034480322 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.764803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8ce2f-6549-4e65-b4a6-f5c034480322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:53.767191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8ce2f-6549-4e65-b4a6-f5c034480322 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:53.789862 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1218/2436] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:53:53 2022] POST /identity/v3/users => generated 301 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:53:53.791401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105973f-6f5b-4799-af86-eb662fe5229e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:53.803379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9105973f-6f5b-4799-af86-eb662fe5229e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:53.808397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c7155-7f3f-44a3-9ce9-5be363616e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:53.809355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c7155-7f3f-44a3-9ce9-5be363616e23 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.809639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c7155-7f3f-44a3-9ce9-5be363616e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.810004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c7155-7f3f-44a3-9ce9-5be363616e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.810747 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c7155-7f3f-44a3-9ce9-5be363616e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:53.812375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c7155-7f3f-44a3-9ce9-5be363616e23 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:53.824088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1219/2437] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:53:53.828451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8ce2f-6549-4e65-b4a6-f5c034480322 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:53.838261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8ce2f-6549-4e65-b4a6-f5c034480322 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:53.843596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb449595-1f11-4b56-939e-a0c83c04c4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:53.844255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb449595-1f11-4b56-939e-a0c83c04c4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.844540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb449595-1f11-4b56-939e-a0c83c04c4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.844836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb449595-1f11-4b56-939e-a0c83c04c4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.845553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb449595-1f11-4b56-939e-a0c83c04c4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:53.847140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb449595-1f11-4b56-939e-a0c83c04c4d8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:53.857580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1219/2438] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:53:53.861564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c7155-7f3f-44a3-9ce9-5be363616e23 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:53.871753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c7155-7f3f-44a3-9ce9-5be363616e23 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:53.876892 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36477d62-3783-4478-bec0-323112f6fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:53.877960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36477d62-3783-4478-bec0-323112f6fbe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.878166 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36477d62-3783-4478-bec0-323112f6fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.878474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36477d62-3783-4478-bec0-323112f6fbe6 admin admin] PATH_INFO: `/v3/projects/9a9b744f41c64576875e8a101f0eb349/users/25d5169cf3114b4785e63760cc874a45/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.893361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36477d62-3783-4478-bec0-323112f6fbe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9b744f41c64576875e8a101f0eb349, user_id=25d5169cf3114b4785e63760cc874a45, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:53.896132 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36477d62-3783-4478-bec0-323112f6fbe6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:53.909301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1220/2439] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:53:53 2022] PUT /identity/v3/projects/9a9b744f41c64576875e8a101f0eb349/users/25d5169cf3114b4785e63760cc874a45/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:53.921231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c78a82-8a02-4575-a3c2-a4dc7edcf354 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:53.921468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c78a82-8a02-4575-a3c2-a4dc7edcf354 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:53.921758 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c78a82-8a02-4575-a3c2-a4dc7edcf354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:53.948673 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-33c78a82-8a02-4575-a3c2-a4dc7edcf354 None None] MFA Rules not processed for user `25d5169cf3114b4785e63760cc874a45`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:53.950562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-33c78a82-8a02-4575-a3c2-a4dc7edcf354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:54.011469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1220/2440] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:53:54.016980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36477d62-3783-4478-bec0-323112f6fbe6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:54.076209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36477d62-3783-4478-bec0-323112f6fbe6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:54.081076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea931c51-04ef-4d0d-9866-2ed0494c55ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:54.081741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea931c51-04ef-4d0d-9866-2ed0494c55ce admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:54.082030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea931c51-04ef-4d0d-9866-2ed0494c55ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:54.082314 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea931c51-04ef-4d0d-9866-2ed0494c55ce admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:54.083025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea931c51-04ef-4d0d-9866-2ed0494c55ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:54.084985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea931c51-04ef-4d0d-9866-2ed0494c55ce admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:54.110018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1221/2441] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:53:54 2022] POST /identity/v3/projects => generated 401 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:53:54.114154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c78a82-8a02-4575-a3c2-a4dc7edcf354 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:54.126838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c78a82-8a02-4575-a3c2-a4dc7edcf354 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:54.188893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a448d22-b325-4406-904b-3545a59d8276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:54.189533 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a448d22-b325-4406-904b-3545a59d8276 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:54.189826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a448d22-b325-4406-904b-3545a59d8276 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:54.190110 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a448d22-b325-4406-904b-3545a59d8276 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:54.190841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a448d22-b325-4406-904b-3545a59d8276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:54.192826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a448d22-b325-4406-904b-3545a59d8276 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:54.215313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1221/2442] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:53:54 2022] POST /identity/v3/users => generated 307 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:53:54.220058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea931c51-04ef-4d0d-9866-2ed0494c55ce admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:54.246159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea931c51-04ef-4d0d-9866-2ed0494c55ce admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:54.261089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233d75-4d68-4397-b584-0ebfa48d65ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:54.262015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233d75-4d68-4397-b584-0ebfa48d65ca admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:54.263498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233d75-4d68-4397-b584-0ebfa48d65ca admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:54.264003 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233d75-4d68-4397-b584-0ebfa48d65ca admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:54.264937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3233d75-4d68-4397-b584-0ebfa48d65ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:54.266980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3233d75-4d68-4397-b584-0ebfa48d65ca admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:54.277862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1222/2443] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:53:54.283074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a448d22-b325-4406-904b-3545a59d8276 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:54.293977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a448d22-b325-4406-904b-3545a59d8276 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:54.299943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b3586-c6be-4907-b93a-3ba1b9ee3ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:54.300907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3586-c6be-4907-b93a-3ba1b9ee3ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:54.301268 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3586-c6be-4907-b93a-3ba1b9ee3ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:54.301613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b3586-c6be-4907-b93a-3ba1b9ee3ddc admin admin] PATH_INFO: `/v3/projects/30ee6f981f574b48a0c3d60e5977b35d/users/8e09b1ad0c924bddbb4061d61c1529a7/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:54.317879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b3586-c6be-4907-b93a-3ba1b9ee3ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ee6f981f574b48a0c3d60e5977b35d, user_id=8e09b1ad0c924bddbb4061d61c1529a7, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:54.320588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b3586-c6be-4907-b93a-3ba1b9ee3ddc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:54.335086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1222/2444] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:53:54 2022] PUT /identity/v3/projects/30ee6f981f574b48a0c3d60e5977b35d/users/8e09b1ad0c924bddbb4061d61c1529a7/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:54.339109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233d75-4d68-4397-b584-0ebfa48d65ca admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:54.350016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233d75-4d68-4397-b584-0ebfa48d65ca admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:54.405914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efddd0-8517-4417-b179-1babade031cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:54.406588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efddd0-8517-4417-b179-1babade031cc admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:54.406869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efddd0-8517-4417-b179-1babade031cc admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:54.407146 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efddd0-8517-4417-b179-1babade031cc admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:54.407911 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efddd0-8517-4417-b179-1babade031cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:54.409491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efddd0-8517-4417-b179-1babade031cc admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:54.419723 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1223/2445] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:53:54.423818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b3586-c6be-4907-b93a-3ba1b9ee3ddc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:54.434575 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b3586-c6be-4907-b93a-3ba1b9ee3ddc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:54.443354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d75e-e7f6-43a3-83f3-c4c5240f747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:54.443713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d75e-e7f6-43a3-83f3-c4c5240f747d admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:54.444001 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d75e-e7f6-43a3-83f3-c4c5240f747d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:54.444282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d551d75e-e7f6-43a3-83f3-c4c5240f747d admin admin] PATH_INFO: `/v3/projects/30ee6f981f574b48a0c3d60e5977b35d/users/8e09b1ad0c924bddbb4061d61c1529a7/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:54.446520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551d75e-e7f6-43a3-83f3-c4c5240f747d admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ee6f981f574b48a0c3d60e5977b35d, user_id=8e09b1ad0c924bddbb4061d61c1529a7, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:54.449414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d551d75e-e7f6-43a3-83f3-c4c5240f747d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:54.462734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1223/2446] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:53:54 2022] PUT /identity/v3/projects/30ee6f981f574b48a0c3d60e5977b35d/users/8e09b1ad0c924bddbb4061d61c1529a7/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:54.474389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb08189-3f0d-43de-9a27-10d8c03df2f8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:54.474684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb08189-3f0d-43de-9a27-10d8c03df2f8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:54.474967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb08189-3f0d-43de-9a27-10d8c03df2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:54.512906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9eb08189-3f0d-43de-9a27-10d8c03df2f8 None None] MFA Rules not processed for user `8e09b1ad0c924bddbb4061d61c1529a7`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:54.514141 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9eb08189-3f0d-43de-9a27-10d8c03df2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:54.598412 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1224/2447] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:54 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:54.609563 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d75e-e7f6-43a3-83f3-c4c5240f747d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:54.611677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d551d75e-e7f6-43a3-83f3-c4c5240f747d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:54.671764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d551d75e-e7f6-43a3-83f3-c4c5240f747d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:54.675690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaf7b6-164c-4ab6-bbd0-66b946e87975 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:54.676341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaf7b6-164c-4ab6-bbd0-66b946e87975 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:54.676624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaf7b6-164c-4ab6-bbd0-66b946e87975 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:54.676904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaf7b6-164c-4ab6-bbd0-66b946e87975 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:54.686710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaf7b6-164c-4ab6-bbd0-66b946e87975 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:54.688279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaf7b6-164c-4ab6-bbd0-66b946e87975 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:54.701186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1224/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:54.777869 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb08189-3f0d-43de-9a27-10d8c03df2f8 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:54.788476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb08189-3f0d-43de-9a27-10d8c03df2f8 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:54.792164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac5e90-8706-416e-b283-27bfb49d4688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:54.792821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac5e90-8706-416e-b283-27bfb49d4688 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:54.793104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac5e90-8706-416e-b283-27bfb49d4688 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:54.793444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac5e90-8706-416e-b283-27bfb49d4688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:54.851430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac5e90-8706-416e-b283-27bfb49d4688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:54.852909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac5e90-8706-416e-b283-27bfb49d4688 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:54.862176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1225/2449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:58.913226 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaf7b6-164c-4ab6-bbd0-66b946e87975 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:58.983288 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaf7b6-164c-4ab6-bbd0-66b946e87975 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:58.987897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:58.988821 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:58.989195 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:58.989358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] PATH_INFO: `/v3/users/25d5169cf3114b4785e63760cc874a45` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:58.990570 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d5169cf3114b4785e63760cc874a45)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:58.992547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:59.037939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d5169cf3114b4785e63760cc874a45'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.045131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d5169cf3114b4785e63760cc874a45'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.056215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d5169cf3114b4785e63760cc874a45'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.063286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d5169cf3114b4785e63760cc874a45'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.063870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d5169cf3114b4785e63760cc874a45'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.069588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1225/2450] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:53:58 2022] DELETE /identity/v3/users/25d5169cf3114b4785e63760cc874a45 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:59.074184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6d0f1-857f-4fb9-8d5a-c87412ff75e9 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:59.074688 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6d0f1-857f-4fb9-8d5a-c87412ff75e9 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:59.075009 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6d0f1-857f-4fb9-8d5a-c87412ff75e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:59.092847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-64d6d0f1-857f-4fb9-8d5a-c87412ff75e9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:53:59.094120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-64d6d0f1-857f-4fb9-8d5a-c87412ff75e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:59.151449 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1226/2451] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:53:59.162085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:59.163743 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:59.222870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6f861-2730-4c63-8258-976b816d14dc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:59.226234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0697e-43fa-48ad-939f-90573f0348fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:59.227004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0697e-43fa-48ad-939f-90573f0348fc service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:59.227282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0697e-43fa-48ad-939f-90573f0348fc service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:59.227611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0697e-43fa-48ad-939f-90573f0348fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:59.237803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0697e-43fa-48ad-939f-90573f0348fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:59.239355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0697e-43fa-48ad-939f-90573f0348fc service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:59.250855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1226/2452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:53:59.595488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6d0f1-857f-4fb9-8d5a-c87412ff75e9 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:59.597291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-64d6d0f1-857f-4fb9-8d5a-c87412ff75e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:53:59.609723 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6d0f1-857f-4fb9-8d5a-c87412ff75e9 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:59.614384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:59.615253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:59.615540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:59.615851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] PATH_INFO: `/v3/projects/9a9b744f41c64576875e8a101f0eb349` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:59.617136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9b744f41c64576875e8a101f0eb349)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:59.618970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:59.665508 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9b744f41c64576875e8a101f0eb349', 'request_id': 'req-2a171a94-224a-4545-a1bc-b5204ff7e0d7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.671857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9b744f41c64576875e8a101f0eb349', 'request_id': 'req-2a171a94-224a-4545-a1bc-b5204ff7e0d7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.677981 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9b744f41c64576875e8a101f0eb349', 'request_id': 'req-2a171a94-224a-4545-a1bc-b5204ff7e0d7'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.688539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] The token cache is being invalidate because project 9a9b744f41c64576875e8a101f0eb349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:53:59.688827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.689450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.690976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1227/2453] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:53:59 2022] DELETE /identity/v3/projects/9a9b744f41c64576875e8a101f0eb349 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:53:59.694917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0697e-43fa-48ad-939f-90573f0348fc service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:53:59.705030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0697e-43fa-48ad-939f-90573f0348fc service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:53:59.758323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:53:59.759185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:53:59.759469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:53:59.759776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] PATH_INFO: `/v3/users/8e09b1ad0c924bddbb4061d61c1529a7` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:53:59.760981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e09b1ad0c924bddbb4061d61c1529a7)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:53:59.763722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:53:59.804859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e09b1ad0c924bddbb4061d61c1529a7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.811807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e09b1ad0c924bddbb4061d61c1529a7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.822773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e09b1ad0c924bddbb4061d61c1529a7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.830175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e09b1ad0c924bddbb4061d61c1529a7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.830933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-9aec1775-2c1d-4ca2-8621-e8087e6997aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e09b1ad0c924bddbb4061d61c1529a7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:53:59.836714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1227/2454] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:53:59 2022] DELETE /identity/v3/users/8e09b1ad0c924bddbb4061d61c1529a7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:00.119442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:00.120953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:00.135418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a171a94-224a-4545-a1bc-b5204ff7e0d7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:00.195629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:00.196505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.196791 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.197071 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] PATH_INFO: `/v3/projects/30ee6f981f574b48a0c3d60e5977b35d` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.198271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ee6f981f574b48a0c3d60e5977b35d)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:00.200294 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:00.245283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ee6f981f574b48a0c3d60e5977b35d', 'request_id': 'req-c28b724a-19c0-4705-a394-7effefec6aa8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:00.253905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ee6f981f574b48a0c3d60e5977b35d', 'request_id': 'req-c28b724a-19c0-4705-a394-7effefec6aa8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:00.259926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ee6f981f574b48a0c3d60e5977b35d', 'request_id': 'req-c28b724a-19c0-4705-a394-7effefec6aa8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:00.270346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] The token cache is being invalidate because project 30ee6f981f574b48a0c3d60e5977b35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:54:00.270635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:00.271258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c28b724a-19c0-4705-a394-7effefec6aa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:00.272792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1228/2455] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:54:00 2022] DELETE /identity/v3/projects/30ee6f981f574b48a0c3d60e5977b35d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:00.280683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d625a-3596-4d32-9c9e-139c01f30333 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.281187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d625a-3596-4d32-9c9e-139c01f30333 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.281283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d625a-3596-4d32-9c9e-139c01f30333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.299477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ac9d625a-3596-4d32-9c9e-139c01f30333 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:00.300710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ac9d625a-3596-4d32-9c9e-139c01f30333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:00.357448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1228/2456] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:00.365130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffff5-22bb-4d8c-8c16-7a42c1d74eba None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.365357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffff5-22bb-4d8c-8c16-7a42c1d74eba None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.365639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ffff5-22bb-4d8c-8c16-7a42c1d74eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.383522 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9b8ffff5-22bb-4d8c-8c16-7a42c1d74eba None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:00.384740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9b8ffff5-22bb-4d8c-8c16-7a42c1d74eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:00.393305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1229/2457] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:00.397269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d625a-3596-4d32-9c9e-139c01f30333 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:00.407138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d625a-3596-4d32-9c9e-139c01f30333 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:00.411727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2179ee-53cf-4a97-ad04-c5074f86373c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:00.412376 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2179ee-53cf-4a97-ad04-c5074f86373c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.412664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2179ee-53cf-4a97-ad04-c5074f86373c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.412945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2179ee-53cf-4a97-ad04-c5074f86373c admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.413683 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2179ee-53cf-4a97-ad04-c5074f86373c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:54:00.413994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2179ee-53cf-4a97-ad04-c5074f86373c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:00.415657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2179ee-53cf-4a97-ad04-c5074f86373c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:00.427810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1229/2458] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:54:00.431731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ffff5-22bb-4d8c-8c16-7a42c1d74eba None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:00.441063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ffff5-22bb-4d8c-8c16-7a42c1d74eba None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:00.445607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b76d2-ded9-4bf7-85c6-73788290ba54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:00.446244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b76d2-ded9-4bf7-85c6-73788290ba54 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.446528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b76d2-ded9-4bf7-85c6-73788290ba54 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.446802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b76d2-ded9-4bf7-85c6-73788290ba54 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.447597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b76d2-ded9-4bf7-85c6-73788290ba54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:00.449586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b76d2-ded9-4bf7-85c6-73788290ba54 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:00.475663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1230/2459] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:54:00 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:54:00.479858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2179ee-53cf-4a97-ad04-c5074f86373c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:00.490132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2179ee-53cf-4a97-ad04-c5074f86373c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:00.547524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f51af7-65b7-46f2-87de-f86de787a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:00.548289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f51af7-65b7-46f2-87de-f86de787a868 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.548739 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f51af7-65b7-46f2-87de-f86de787a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.549535 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f51af7-65b7-46f2-87de-f86de787a868 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.549767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f51af7-65b7-46f2-87de-f86de787a868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:00.551768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f51af7-65b7-46f2-87de-f86de787a868 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:00.574994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1230/2460] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:54:00 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:54:00.576297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b76d2-ded9-4bf7-85c6-73788290ba54 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:00.586535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b76d2-ded9-4bf7-85c6-73788290ba54 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:00.592004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69b4fa-8c95-479e-96c3-505f02747282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:00.592672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69b4fa-8c95-479e-96c3-505f02747282 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.592959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69b4fa-8c95-479e-96c3-505f02747282 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.593240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69b4fa-8c95-479e-96c3-505f02747282 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.593975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69b4fa-8c95-479e-96c3-505f02747282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:00.595586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69b4fa-8c95-479e-96c3-505f02747282 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:00.606054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1231/2461] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:54:00.610020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f51af7-65b7-46f2-87de-f86de787a868 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:00.620079 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f51af7-65b7-46f2-87de-f86de787a868 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:00.625364 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b470937-bf60-4ce9-af73-1dac06888576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:00.626034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470937-bf60-4ce9-af73-1dac06888576 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.626324 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470937-bf60-4ce9-af73-1dac06888576 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.626605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470937-bf60-4ce9-af73-1dac06888576 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.627358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b470937-bf60-4ce9-af73-1dac06888576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:00.629013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b470937-bf60-4ce9-af73-1dac06888576 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:00.639217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1231/2462] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:54:00.643752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69b4fa-8c95-479e-96c3-505f02747282 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:00.654640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69b4fa-8c95-479e-96c3-505f02747282 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:00.659491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77c94b-1b5e-4c05-bcf5-1548f18cc52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:00.660437 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c94b-1b5e-4c05-bcf5-1548f18cc52f admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.660722 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c94b-1b5e-4c05-bcf5-1548f18cc52f admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.661003 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77c94b-1b5e-4c05-bcf5-1548f18cc52f admin admin] PATH_INFO: `/v3/projects/7d4f54b25d584b5e95b6d795dce1de7a/users/cc3fae22d5d94faa90a7ef7d6b91a280/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.677395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77c94b-1b5e-4c05-bcf5-1548f18cc52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4f54b25d584b5e95b6d795dce1de7a, user_id=cc3fae22d5d94faa90a7ef7d6b91a280, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:00.680138 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77c94b-1b5e-4c05-bcf5-1548f18cc52f admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:00.694555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1232/2463] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:54:00 2022] PUT /identity/v3/projects/7d4f54b25d584b5e95b6d795dce1de7a/users/cc3fae22d5d94faa90a7ef7d6b91a280/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:00.706189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a1055-f061-4318-b79c-3449a6641508 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.706486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a1055-f061-4318-b79c-3449a6641508 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.706775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a1055-f061-4318-b79c-3449a6641508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.735988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-173a1055-f061-4318-b79c-3449a6641508 None None] MFA Rules not processed for user `cc3fae22d5d94faa90a7ef7d6b91a280`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:00.737218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-173a1055-f061-4318-b79c-3449a6641508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:00.801097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1232/2464] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:00.811087 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77c94b-1b5e-4c05-bcf5-1548f18cc52f admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:00.812816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9e77c94b-1b5e-4c05-bcf5-1548f18cc52f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:00.875886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77c94b-1b5e-4c05-bcf5-1548f18cc52f admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:00.879686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2b43e-c24d-405b-abe5-e9d449936aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:00.880336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2b43e-c24d-405b-abe5-e9d449936aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:00.880620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2b43e-c24d-405b-abe5-e9d449936aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:00.880900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2b43e-c24d-405b-abe5-e9d449936aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:00.896573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2b43e-c24d-405b-abe5-e9d449936aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:00.898023 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def2b43e-c24d-405b-abe5-e9d449936aa5 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:00.908305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1233/2465] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:00.927054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a1055-f061-4318-b79c-3449a6641508 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:00.993723 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a1055-f061-4318-b79c-3449a6641508 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:00.998996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:00.999900 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.000180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.000456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] PATH_INFO: `/v3/users/cc3fae22d5d94faa90a7ef7d6b91a280` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.001655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3fae22d5d94faa90a7ef7d6b91a280)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:01.003596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:01.019151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2b43e-c24d-405b-abe5-e9d449936aa5 service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:01.020754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-def2b43e-c24d-405b-abe5-e9d449936aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:01.050703 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3fae22d5d94faa90a7ef7d6b91a280'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.057888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3fae22d5d94faa90a7ef7d6b91a280'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.070191 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3fae22d5d94faa90a7ef7d6b91a280'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.078331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3fae22d5d94faa90a7ef7d6b91a280'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.079043 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-72ef2df2-18a4-4c15-a32b-08a91b8594b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3fae22d5d94faa90a7ef7d6b91a280'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.079507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2b43e-c24d-405b-abe5-e9d449936aa5 service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:01.083321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:01.083986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.084269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.084544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.085229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1233/2466] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:54:00 2022] DELETE /identity/v3/users/cc3fae22d5d94faa90a7ef7d6b91a280 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:01.086316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:01.089624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc0e6-815c-43b6-b4e2-c58508cc1b38 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.089936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc0e6-815c-43b6-b4e2-c58508cc1b38 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.090220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc0e6-815c-43b6-b4e2-c58508cc1b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.096477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:01.097905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:01.105616 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1234/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:54:01.107969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-789dc0e6-815c-43b6-b4e2-c58508cc1b38 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:01.109212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-789dc0e6-815c-43b6-b4e2-c58508cc1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:01.166750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1234/2468] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:54:01.176914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:01.178336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:01.188471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970b502-791d-43d4-993f-45dd16730180 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:01.237035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a89683-e2ee-44bc-b908-d201f28e1e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:01.237703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a89683-e2ee-44bc-b908-d201f28e1e81 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.237989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a89683-e2ee-44bc-b908-d201f28e1e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.238261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a89683-e2ee-44bc-b908-d201f28e1e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.247217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a89683-e2ee-44bc-b908-d201f28e1e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:01.248687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a89683-e2ee-44bc-b908-d201f28e1e81 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:01.258433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1235/2469] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:54:01.583501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dc0e6-815c-43b6-b4e2-c58508cc1b38 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:01.584995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-789dc0e6-815c-43b6-b4e2-c58508cc1b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:01.599236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dc0e6-815c-43b6-b4e2-c58508cc1b38 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:01.604073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:01.604933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.605343 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.605715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] PATH_INFO: `/v3/projects/7d4f54b25d584b5e95b6d795dce1de7a` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.607273 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4f54b25d584b5e95b6d795dce1de7a)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:01.609080 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:01.657833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4f54b25d584b5e95b6d795dce1de7a', 'request_id': 'req-86a48040-513f-4158-b3c4-d0450e12dcbc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.663902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4f54b25d584b5e95b6d795dce1de7a', 'request_id': 'req-86a48040-513f-4158-b3c4-d0450e12dcbc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.669317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4f54b25d584b5e95b6d795dce1de7a', 'request_id': 'req-86a48040-513f-4158-b3c4-d0450e12dcbc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.680593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] The token cache is being invalidate because project 7d4f54b25d584b5e95b6d795dce1de7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:54:01.680886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.681499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-86a48040-513f-4158-b3c4-d0450e12dcbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:01.683023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1235/2470] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:54:01 2022] DELETE /identity/v3/projects/7d4f54b25d584b5e95b6d795dce1de7a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:01.688762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b94df-3a07-4331-bdf7-42f02e60d3b8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.689050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b94df-3a07-4331-bdf7-42f02e60d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.689326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b94df-3a07-4331-bdf7-42f02e60d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.707616 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-327b94df-3a07-4331-bdf7-42f02e60d3b8 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:01.708807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-327b94df-3a07-4331-bdf7-42f02e60d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:01.767204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1236/2471] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:01.775980 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec5404-7084-487e-8383-893414356def None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.776271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec5404-7084-487e-8383-893414356def None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.776550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec5404-7084-487e-8383-893414356def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.795382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-b3ec5404-7084-487e-8383-893414356def None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:01.796625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b3ec5404-7084-487e-8383-893414356def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:01.804633 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1236/2472] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:01.809346 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b94df-3a07-4331-bdf7-42f02e60d3b8 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:01.819375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b94df-3a07-4331-bdf7-42f02e60d3b8 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:01.823958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0a59f-4186-4276-b31b-e8347ee6db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:01.825206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0a59f-4186-4276-b31b-e8347ee6db65 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.825666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0a59f-4186-4276-b31b-e8347ee6db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.825945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0a59f-4186-4276-b31b-e8347ee6db65 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.826681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0a59f-4186-4276-b31b-e8347ee6db65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:54:01.826991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0a59f-4186-4276-b31b-e8347ee6db65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:01.828692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0a59f-4186-4276-b31b-e8347ee6db65 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:01.840027 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1237/2473] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:54:01.844395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec5404-7084-487e-8383-893414356def None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:01.853260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec5404-7084-487e-8383-893414356def None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:01.858232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eacf8-c926-4a6d-b189-8e568517f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:01.858869 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eacf8-c926-4a6d-b189-8e568517f62e admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.859153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eacf8-c926-4a6d-b189-8e568517f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.859427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216eacf8-c926-4a6d-b189-8e568517f62e admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.860163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216eacf8-c926-4a6d-b189-8e568517f62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:01.862068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216eacf8-c926-4a6d-b189-8e568517f62e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:01.887396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1237/2474] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:54:01 2022] POST /identity/v3/projects => generated 375 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:54:01.891580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0a59f-4186-4276-b31b-e8347ee6db65 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:01.901315 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0a59f-4186-4276-b31b-e8347ee6db65 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:01.957076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a5ef4-3fe5-4aa2-b49f-8d4da592a354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:01.957661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a5ef4-3fe5-4aa2-b49f-8d4da592a354 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:01.957947 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a5ef4-3fe5-4aa2-b49f-8d4da592a354 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:01.958225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a5ef4-3fe5-4aa2-b49f-8d4da592a354 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:01.958935 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a5ef4-3fe5-4aa2-b49f-8d4da592a354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:01.960877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a5ef4-3fe5-4aa2-b49f-8d4da592a354 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:01.979903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1238/2475] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:54:01 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:54:01.984872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eacf8-c926-4a6d-b189-8e568517f62e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:01.994687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216eacf8-c926-4a6d-b189-8e568517f62e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:01.999407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d1a85-da69-47e4-818c-6849eac45e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:02.000094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d1a85-da69-47e4-818c-6849eac45e97 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:02.000378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d1a85-da69-47e4-818c-6849eac45e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:02.000658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d1a85-da69-47e4-818c-6849eac45e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:02.001379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d1a85-da69-47e4-818c-6849eac45e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:02.002982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d1a85-da69-47e4-818c-6849eac45e97 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:02.013328 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1238/2476] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:54:02.017309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a5ef4-3fe5-4aa2-b49f-8d4da592a354 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:02.026801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a5ef4-3fe5-4aa2-b49f-8d4da592a354 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:02.031944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c3902a-5b5e-4c3f-94f0-52cf2c4c187c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:02.032599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3902a-5b5e-4c3f-94f0-52cf2c4c187c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:02.032886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3902a-5b5e-4c3f-94f0-52cf2c4c187c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:02.033170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3902a-5b5e-4c3f-94f0-52cf2c4c187c admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:02.033899 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3902a-5b5e-4c3f-94f0-52cf2c4c187c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:02.035693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c3902a-5b5e-4c3f-94f0-52cf2c4c187c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:02.045388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1239/2477] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:54:02.049361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d1a85-da69-47e4-818c-6849eac45e97 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:02.059610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d1a85-da69-47e4-818c-6849eac45e97 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:02.064155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b23f9-d848-4c9f-918c-1b29e0f68cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:02.065027 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b23f9-d848-4c9f-918c-1b29e0f68cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:02.065315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b23f9-d848-4c9f-918c-1b29e0f68cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:02.065627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b23f9-d848-4c9f-918c-1b29e0f68cb4 admin admin] PATH_INFO: `/v3/projects/efd180c97a86484aa4e74faa5b703d26/users/038878818ac4482482a67068099f8858/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:02.080087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b23f9-d848-4c9f-918c-1b29e0f68cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd180c97a86484aa4e74faa5b703d26, user_id=038878818ac4482482a67068099f8858, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:02.082726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b23f9-d848-4c9f-918c-1b29e0f68cb4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:02.095236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1239/2478] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:54:02 2022] PUT /identity/v3/projects/efd180c97a86484aa4e74faa5b703d26/users/038878818ac4482482a67068099f8858/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:02.105283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46e768-fc4a-4199-ac1c-a3352957b677 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:02.105629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46e768-fc4a-4199-ac1c-a3352957b677 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:02.105909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46e768-fc4a-4199-ac1c-a3352957b677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:02.131367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ff46e768-fc4a-4199-ac1c-a3352957b677 None None] MFA Rules not processed for user `038878818ac4482482a67068099f8858`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:02.132622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ff46e768-fc4a-4199-ac1c-a3352957b677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:02.195724 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1240/2479] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:02.205494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b23f9-d848-4c9f-918c-1b29e0f68cb4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:02.207219 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d62b23f9-d848-4c9f-918c-1b29e0f68cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:02.262605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b23f9-d848-4c9f-918c-1b29e0f68cb4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:02.266913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ae5ae-1a2f-492f-9c54-9d9eb965ab1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:02.267613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ae5ae-1a2f-492f-9c54-9d9eb965ab1c service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:02.267977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ae5ae-1a2f-492f-9c54-9d9eb965ab1c service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:02.268264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ae5ae-1a2f-492f-9c54-9d9eb965ab1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:02.278147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ae5ae-1a2f-492f-9c54-9d9eb965ab1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:02.279746 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ae5ae-1a2f-492f-9c54-9d9eb965ab1c service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:02.289274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1240/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:06.649254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46e768-fc4a-4199-ac1c-a3352957b677 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:06.650764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ff46e768-fc4a-4199-ac1c-a3352957b677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:06.663147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46e768-fc4a-4199-ac1c-a3352957b677 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:06.666743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:06.667384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:06.667707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:06.668084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:06.669803 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:06.728208 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:06.729578 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:06.739196 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1241/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:07.538359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ae5ae-1a2f-492f-9c54-9d9eb965ab1c service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:07.539853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-005ae5ae-1a2f-492f-9c54-9d9eb965ab1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:07.610101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ae5ae-1a2f-492f-9c54-9d9eb965ab1c service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:07.615593 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13055eba-fcdb-4c29-80fa-931125bc8cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:07.616240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13055eba-fcdb-4c29-80fa-931125bc8cd2 service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:07.616529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13055eba-fcdb-4c29-80fa-931125bc8cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:07.616813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13055eba-fcdb-4c29-80fa-931125bc8cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:07.618558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-13055eba-fcdb-4c29-80fa-931125bc8cd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:07.674536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13055eba-fcdb-4c29-80fa-931125bc8cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:07.676151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13055eba-fcdb-4c29-80fa-931125bc8cd2 service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:07.685083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1241/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:12.083930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:12.085476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:12.104112 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bee07-5066-4829-a84a-fbc7d07b0e6b service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:12.111670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0591f-5e30-4f4b-b97b-51d8a7589ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:12.112341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0591f-5e30-4f4b-b97b-51d8a7589ad1 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:12.112626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0591f-5e30-4f4b-b97b-51d8a7589ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:12.112921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0591f-5e30-4f4b-b97b-51d8a7589ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:12.119960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-22e0591f-5e30-4f4b-b97b-51d8a7589ad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:12.132846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0591f-5e30-4f4b-b97b-51d8a7589ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:12.134731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0591f-5e30-4f4b-b97b-51d8a7589ad1 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:12.158304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1242/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:15.385752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b7e2d-f2a2-436f-9149-301027e849ab None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:15.386840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b7e2d-f2a2-436f-9149-301027e849ab None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:15.386840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b7e2d-f2a2-436f-9149-301027e849ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:15.404362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ae1b7e2d-f2a2-436f-9149-301027e849ab None None] MFA Rules not processed for user `20137a83d3de4dcfaba05ab93c470829`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:15.405551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ae1b7e2d-f2a2-436f-9149-301027e849ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:15.412266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1242/2484] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:19.784718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0591f-5e30-4f4b-b97b-51d8a7589ad1 service nova] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:19.844624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0591f-5e30-4f4b-b97b-51d8a7589ad1 service nova] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:19.849025 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:19.849884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:19.850167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:19.850445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] PATH_INFO: `/v3/users/038878818ac4482482a67068099f8858` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:19.851645 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038878818ac4482482a67068099f8858)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:19.853665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:19.897587 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038878818ac4482482a67068099f8858'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:19.904885 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038878818ac4482482a67068099f8858'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:19.905573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038878818ac4482482a67068099f8858'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:19.916669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038878818ac4482482a67068099f8858'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:19.924051 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038878818ac4482482a67068099f8858'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:19.929758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1243/2485] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:54:19 2022] DELETE /identity/v3/users/038878818ac4482482a67068099f8858 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:19.934346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1f97-608a-4f2a-9222-29d86ed190ca None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:19.934814 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1f97-608a-4f2a-9222-29d86ed190ca None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:19.934933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa1f97-608a-4f2a-9222-29d86ed190ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:19.951949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-39aa1f97-608a-4f2a-9222-29d86ed190ca None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:19.953086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-39aa1f97-608a-4f2a-9222-29d86ed190ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:20.009083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1243/2486] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:54:20.018905 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:20.020339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:20.075594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f87862-b15d-4a8d-aa85-3c04f627a2c7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:20.080177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b2906-3fc0-4453-ba39-1d27b1b854da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:20.080823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2906-3fc0-4453-ba39-1d27b1b854da service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.081105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2906-3fc0-4453-ba39-1d27b1b854da service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.081380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b2906-3fc0-4453-ba39-1d27b1b854da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.090125 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b2906-3fc0-4453-ba39-1d27b1b854da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:20.091533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b2906-3fc0-4453-ba39-1d27b1b854da service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:20.100787 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1244/2487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:20.351098 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1f97-608a-4f2a-9222-29d86ed190ca None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:20.352623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-39aa1f97-608a-4f2a-9222-29d86ed190ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:20.364827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa1f97-608a-4f2a-9222-29d86ed190ca None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:20.369391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:20.370244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.370532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.370815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] PATH_INFO: `/v3/projects/efd180c97a86484aa4e74faa5b703d26` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.372047 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd180c97a86484aa4e74faa5b703d26)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:20.375542 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:20.422537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd180c97a86484aa4e74faa5b703d26', 'request_id': 'req-cf9a5fc2-6abe-4e92-abea-2489161f041d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:20.428615 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd180c97a86484aa4e74faa5b703d26', 'request_id': 'req-cf9a5fc2-6abe-4e92-abea-2489161f041d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:20.434108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd180c97a86484aa4e74faa5b703d26', 'request_id': 'req-cf9a5fc2-6abe-4e92-abea-2489161f041d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:20.447171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] The token cache is being invalidate because project efd180c97a86484aa4e74faa5b703d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:54:20.447646 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:20.448812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cf9a5fc2-6abe-4e92-abea-2489161f041d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:20.450417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1244/2488] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:54:20 2022] DELETE /identity/v3/projects/efd180c97a86484aa4e74faa5b703d26 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:20.456389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39163f8-87a3-4f4e-ae6c-e5aa3e9db143 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.456687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39163f8-87a3-4f4e-ae6c-e5aa3e9db143 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.456971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39163f8-87a3-4f4e-ae6c-e5aa3e9db143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.476113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e39163f8-87a3-4f4e-ae6c-e5aa3e9db143 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:20.477304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e39163f8-87a3-4f4e-ae6c-e5aa3e9db143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:20.538694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1245/2489] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:20.547993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a65f9a-7059-4dde-a268-60c792216fe3 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.548286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a65f9a-7059-4dde-a268-60c792216fe3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.548570 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a65f9a-7059-4dde-a268-60c792216fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.567400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-02a65f9a-7059-4dde-a268-60c792216fe3 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:20.568620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-02a65f9a-7059-4dde-a268-60c792216fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:20.577636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1245/2490] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:20.581831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39163f8-87a3-4f4e-ae6c-e5aa3e9db143 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:20.591537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39163f8-87a3-4f4e-ae6c-e5aa3e9db143 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:20.596094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328dbc-6dac-4c6e-8fc0-068bad7a3593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:20.596745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328dbc-6dac-4c6e-8fc0-068bad7a3593 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.597028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328dbc-6dac-4c6e-8fc0-068bad7a3593 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.597331 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc328dbc-6dac-4c6e-8fc0-068bad7a3593 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.598175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328dbc-6dac-4c6e-8fc0-068bad7a3593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:54:20.598517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328dbc-6dac-4c6e-8fc0-068bad7a3593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:20.600076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc328dbc-6dac-4c6e-8fc0-068bad7a3593 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:20.611837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1246/2491] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:54:20.616175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a65f9a-7059-4dde-a268-60c792216fe3 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:20.625786 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a65f9a-7059-4dde-a268-60c792216fe3 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:20.630506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da885be-a216-459a-aca0-9b042e5e3c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:20.631282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da885be-a216-459a-aca0-9b042e5e3c6d admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.631597 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da885be-a216-459a-aca0-9b042e5e3c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.631883 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da885be-a216-459a-aca0-9b042e5e3c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.632607 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da885be-a216-459a-aca0-9b042e5e3c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:20.634498 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da885be-a216-459a-aca0-9b042e5e3c6d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:20.664306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1246/2492] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:54:20 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:54:20.665492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328dbc-6dac-4c6e-8fc0-068bad7a3593 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:20.676030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc328dbc-6dac-4c6e-8fc0-068bad7a3593 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:20.731601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b118-ede6-47d6-a75b-19e2260f35a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:20.732272 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b118-ede6-47d6-a75b-19e2260f35a4 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.732564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b118-ede6-47d6-a75b-19e2260f35a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.732846 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2b118-ede6-47d6-a75b-19e2260f35a4 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.733551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b118-ede6-47d6-a75b-19e2260f35a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:20.735489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2b118-ede6-47d6-a75b-19e2260f35a4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:20.756159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1247/2493] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:54:20 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:54:20.760265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da885be-a216-459a-aca0-9b042e5e3c6d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:20.771258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da885be-a216-459a-aca0-9b042e5e3c6d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:20.775883 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2457b1-7a7f-408d-be58-14af6af48c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:20.776566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2457b1-7a7f-408d-be58-14af6af48c2a admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.776842 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2457b1-7a7f-408d-be58-14af6af48c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.777201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2457b1-7a7f-408d-be58-14af6af48c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.777935 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2457b1-7a7f-408d-be58-14af6af48c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:20.779514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2457b1-7a7f-408d-be58-14af6af48c2a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:20.790086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1247/2494] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:54:20.794416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b118-ede6-47d6-a75b-19e2260f35a4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:20.804124 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2b118-ede6-47d6-a75b-19e2260f35a4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:20.809901 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7f021-927b-45d8-b7e5-06e2e55c5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:20.810668 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7f021-927b-45d8-b7e5-06e2e55c5386 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.810961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7f021-927b-45d8-b7e5-06e2e55c5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.811244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7f021-927b-45d8-b7e5-06e2e55c5386 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.812016 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7f021-927b-45d8-b7e5-06e2e55c5386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:20.813613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7f021-927b-45d8-b7e5-06e2e55c5386 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:20.823215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1248/2495] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:54:20.827652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2457b1-7a7f-408d-be58-14af6af48c2a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:20.837039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2457b1-7a7f-408d-be58-14af6af48c2a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:20.841788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c58b7-0687-49b6-b1b4-bfe0f4b94583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:20.842636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c58b7-0687-49b6-b1b4-bfe0f4b94583 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.842912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c58b7-0687-49b6-b1b4-bfe0f4b94583 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.843183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c58b7-0687-49b6-b1b4-bfe0f4b94583 admin admin] PATH_INFO: `/v3/projects/7294a7a1631344cfa1e5a508f2a28289/users/e9a8702ceb614c1dbfa6d8fc2f8a8862/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.857067 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c58b7-0687-49b6-b1b4-bfe0f4b94583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7294a7a1631344cfa1e5a508f2a28289, user_id=e9a8702ceb614c1dbfa6d8fc2f8a8862, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:20.859741 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c58b7-0687-49b6-b1b4-bfe0f4b94583 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:20.873378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1248/2496] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:54:20 2022] PUT /identity/v3/projects/7294a7a1631344cfa1e5a508f2a28289/users/e9a8702ceb614c1dbfa6d8fc2f8a8862/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:20.884598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07a75f-e669-4896-b4a4-7fc40dfc48c5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:20.884900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07a75f-e669-4896-b4a4-7fc40dfc48c5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:20.885301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07a75f-e669-4896-b4a4-7fc40dfc48c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:20.911906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-cc07a75f-e669-4896-b4a4-7fc40dfc48c5 None None] MFA Rules not processed for user `e9a8702ceb614c1dbfa6d8fc2f8a8862`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:20.913103 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cc07a75f-e669-4896-b4a4-7fc40dfc48c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:20.978534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1249/2497] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:20.988825 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c58b7-0687-49b6-b1b4-bfe0f4b94583 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:20.990582 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f95c58b7-0687-49b6-b1b4-bfe0f4b94583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:21.044790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c58b7-0687-49b6-b1b4-bfe0f4b94583 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:21.048377 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056686b-a2c3-41d6-9ab7-65dfbe6998b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:21.049020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056686b-a2c3-41d6-9ab7-65dfbe6998b9 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:21.049301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056686b-a2c3-41d6-9ab7-65dfbe6998b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:21.049579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056686b-a2c3-41d6-9ab7-65dfbe6998b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:21.057539 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056686b-a2c3-41d6-9ab7-65dfbe6998b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:21.059560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056686b-a2c3-41d6-9ab7-65dfbe6998b9 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:21.068058 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1249/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:22.387421 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65946a5-a305-4c91-9cc8-e5b62f3770fb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:22.387945 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65946a5-a305-4c91-9cc8-e5b62f3770fb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:22.388049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65946a5-a305-4c91-9cc8-e5b62f3770fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:22.405926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b65946a5-a305-4c91-9cc8-e5b62f3770fb None None] MFA Rules not processed for user `e9a8702ceb614c1dbfa6d8fc2f8a8862`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:22.407120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b65946a5-a305-4c91-9cc8-e5b62f3770fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:22.413960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1250/2499] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:23.704240 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056686b-a2c3-41d6-9ab7-65dfbe6998b9 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:23.705812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0056686b-a2c3-41d6-9ab7-65dfbe6998b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:23.783012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056686b-a2c3-41d6-9ab7-65dfbe6998b9 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:23.789311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:23.789961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:23.790315 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:23.790523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:23.792385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:23.805529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:23.807143 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:23.818909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1250/2500] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:26.956915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65946a5-a305-4c91-9cc8-e5b62f3770fb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:26.958347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b65946a5-a305-4c91-9cc8-e5b62f3770fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:26.974319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65946a5-a305-4c91-9cc8-e5b62f3770fb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:26.984597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac74c4-ca2c-48eb-8da7-01cd992d4b0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:26.985261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac74c4-ca2c-48eb-8da7-01cd992d4b0d service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:26.985728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac74c4-ca2c-48eb-8da7-01cd992d4b0d service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:26.986199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac74c4-ca2c-48eb-8da7-01cd992d4b0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:26.988190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ebac74c4-ca2c-48eb-8da7-01cd992d4b0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:27.002365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac74c4-ca2c-48eb-8da7-01cd992d4b0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:27.003995 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac74c4-ca2c-48eb-8da7-01cd992d4b0d service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:27.015199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1251/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:31.551598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:31.553012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:31.606589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53834f0b-dc76-4419-bb01-a0c09a0f076f service nova] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:31.610126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:31.610752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:31.611042 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:31.611321 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:31.613098 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:31.622506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:31.623982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:31.632139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1251/2502] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:37.406498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be20ae1-c51c-41e4-bca1-274c9cfa8ba6 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:37.406943 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be20ae1-c51c-41e4-bca1-274c9cfa8ba6 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:37.407053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be20ae1-c51c-41e4-bca1-274c9cfa8ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:37.424635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-4be20ae1-c51c-41e4-bca1-274c9cfa8ba6 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:37.425797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4be20ae1-c51c-41e4-bca1-274c9cfa8ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:37.477815 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1252/2503] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:54:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:37.523390 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:37.524827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:37.592118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59d554-a87c-4d2b-9383-38bb64452044 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:37.597153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ac29c-6e1e-4fdd-9ace-7f9d20b6a621 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:37.597805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ac29c-6e1e-4fdd-9ace-7f9d20b6a621 service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:37.598094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ac29c-6e1e-4fdd-9ace-7f9d20b6a621 service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:37.598378 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ac29c-6e1e-4fdd-9ace-7f9d20b6a621 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:37.606965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ac29c-6e1e-4fdd-9ace-7f9d20b6a621 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:37.608572 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ac29c-6e1e-4fdd-9ace-7f9d20b6a621 service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:37.616696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1252/2504] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:54:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:54:38.143234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8b1a0-79bf-4635-b2a0-a1a9d970f4a8 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:38.143528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8b1a0-79bf-4635-b2a0-a1a9d970f4a8 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:38.143842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8b1a0-79bf-4635-b2a0-a1a9d970f4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:38.161764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-4cb8b1a0-79bf-4635-b2a0-a1a9d970f4a8 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:38.162936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4cb8b1a0-79bf-4635-b2a0-a1a9d970f4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:38.170925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1253/2505] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jan 27 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:38.183212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ac29c-6e1e-4fdd-9ace-7f9d20b6a621 service swift] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:38.193434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ac29c-6e1e-4fdd-9ace-7f9d20b6a621 service swift] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:38.198645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5357ce-8130-4462-ba0d-ca0127142e82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:38.199263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5357ce-8130-4462-ba0d-ca0127142e82 service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:38.199544 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5357ce-8130-4462-ba0d-ca0127142e82 service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:38.199851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5357ce-8130-4462-ba0d-ca0127142e82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:38.207502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5357ce-8130-4462-ba0d-ca0127142e82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:38.209089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5357ce-8130-4462-ba0d-ca0127142e82 service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:38.217653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1253/2506] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:54:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:54:38.397754 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13b7c-10c8-497a-b46a-bb420089b4f9 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:38.398039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13b7c-10c8-497a-b46a-bb420089b4f9 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:38.398316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13b7c-10c8-497a-b46a-bb420089b4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:38.415907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-64c13b7c-10c8-497a-b46a-bb420089b4f9 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:38.418106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-64c13b7c-10c8-497a-b46a-bb420089b4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:38.425040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1254/2507] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:38.437669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5357ce-8130-4462-ba0d-ca0127142e82 service swift] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:38.447961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5357ce-8130-4462-ba0d-ca0127142e82 service swift] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:38.452958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d568fb3-6619-4e82-a0e5-527643afe061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:38.453592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d568fb3-6619-4e82-a0e5-527643afe061 service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:38.453876 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d568fb3-6619-4e82-a0e5-527643afe061 service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:38.454154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d568fb3-6619-4e82-a0e5-527643afe061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:38.462019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d568fb3-6619-4e82-a0e5-527643afe061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:38.463649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d568fb3-6619-4e82-a0e5-527643afe061 service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:38.471357 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1254/2508] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:54:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:54:38.778572 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3b9ed-fcb6-420f-b492-05d8c09ecc7a None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:38.778867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3b9ed-fcb6-420f-b492-05d8c09ecc7a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:38.779153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3b9ed-fcb6-420f-b492-05d8c09ecc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:38.796322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9cf3b9ed-fcb6-420f-b492-05d8c09ecc7a None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:38.797510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9cf3b9ed-fcb6-420f-b492-05d8c09ecc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:38.804667 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1255/2509] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jan 27 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:38.818029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d568fb3-6619-4e82-a0e5-527643afe061 service swift] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:38.829419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d568fb3-6619-4e82-a0e5-527643afe061 service swift] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:38.834666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbd622-3341-4ebc-b734-2c5d9af08c42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:38.835312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbd622-3341-4ebc-b734-2c5d9af08c42 service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:38.835632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbd622-3341-4ebc-b734-2c5d9af08c42 service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:38.835921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbd622-3341-4ebc-b734-2c5d9af08c42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:38.844274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbd622-3341-4ebc-b734-2c5d9af08c42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:38.845846 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbd622-3341-4ebc-b734-2c5d9af08c42 service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:38.853912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1255/2510] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:54:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:54:40.848502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3b9ed-fcb6-420f-b492-05d8c09ecc7a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:40.908350 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3b9ed-fcb6-420f-b492-05d8c09ecc7a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:40.912823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:40.913686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:40.913979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:40.914259 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] PATH_INFO: `/v3/users/e9a8702ceb614c1dbfa6d8fc2f8a8862` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:40.915444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a8702ceb614c1dbfa6d8fc2f8a8862)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:40.917398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:40.961782 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a8702ceb614c1dbfa6d8fc2f8a8862'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:40.968878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a8702ceb614c1dbfa6d8fc2f8a8862'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:40.969540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a8702ceb614c1dbfa6d8fc2f8a8862'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:40.981236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a8702ceb614c1dbfa6d8fc2f8a8862'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:40.988821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a8702ceb614c1dbfa6d8fc2f8a8862'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:40.995102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1256/2511] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:54:40 2022] DELETE /identity/v3/users/e9a8702ceb614c1dbfa6d8fc2f8a8862 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:40.999548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c33c5-6c2d-465f-bf36-800c34c17682 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.000029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c33c5-6c2d-465f-bf36-800c34c17682 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.000249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c33c5-6c2d-465f-bf36-800c34c17682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.018788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-973c33c5-6c2d-465f-bf36-800c34c17682 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:41.019543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-973c33c5-6c2d-465f-bf36-800c34c17682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:41.081772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1256/2512] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:41.091958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:41.093380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:41.156514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202670fe-6b23-4181-860b-ca5cf72936f2 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:41.160141 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49ce7c-20e2-41a2-a345-7476268596e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:41.160794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ce7c-20e2-41a2-a345-7476268596e5 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.161080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ce7c-20e2-41a2-a345-7476268596e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.161360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ce7c-20e2-41a2-a345-7476268596e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.170630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49ce7c-20e2-41a2-a345-7476268596e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:41.172086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49ce7c-20e2-41a2-a345-7476268596e5 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:41.181164 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1257/2513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:41.340752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c33c5-6c2d-465f-bf36-800c34c17682 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:41.342223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-973c33c5-6c2d-465f-bf36-800c34c17682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:41.355492 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c33c5-6c2d-465f-bf36-800c34c17682 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:41.360247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:41.361534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.361889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.362244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] PATH_INFO: `/v3/projects/7294a7a1631344cfa1e5a508f2a28289` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.363520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7294a7a1631344cfa1e5a508f2a28289)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:41.365484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:41.415661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7294a7a1631344cfa1e5a508f2a28289', 'request_id': 'req-c74fc7db-a927-41fd-bc03-d2f96709a853'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:41.422042 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7294a7a1631344cfa1e5a508f2a28289', 'request_id': 'req-c74fc7db-a927-41fd-bc03-d2f96709a853'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:41.427395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7294a7a1631344cfa1e5a508f2a28289', 'request_id': 'req-c74fc7db-a927-41fd-bc03-d2f96709a853'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:41.440258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] The token cache is being invalidate because project 7294a7a1631344cfa1e5a508f2a28289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:54:41.440557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:41.441182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c74fc7db-a927-41fd-bc03-d2f96709a853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:54:41.442752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1257/2514] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:54:41 2022] DELETE /identity/v3/projects/7294a7a1631344cfa1e5a508f2a28289 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:41.449537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6755975-3afd-44b0-b611-db9525497bcb None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.449856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6755975-3afd-44b0-b611-db9525497bcb None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.450137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6755975-3afd-44b0-b611-db9525497bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.470376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b6755975-3afd-44b0-b611-db9525497bcb None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:41.471593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b6755975-3afd-44b0-b611-db9525497bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:41.558784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1258/2515] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:54:41.566546 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9c93-66f5-45c4-bf50-f6e0db4cc6ee None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.566841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9c93-66f5-45c4-bf50-f6e0db4cc6ee None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.567151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9c93-66f5-45c4-bf50-f6e0db4cc6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.587350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-8bcc9c93-66f5-45c4-bf50-f6e0db4cc6ee None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:41.588635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8bcc9c93-66f5-45c4-bf50-f6e0db4cc6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:41.600256 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1258/2516] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:41.601622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6755975-3afd-44b0-b611-db9525497bcb None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:41.611214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6755975-3afd-44b0-b611-db9525497bcb None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:41.615800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f6fd6-fa38-4f68-9873-696a8ebaf43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:41.616453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6fd6-fa38-4f68-9873-696a8ebaf43c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.616736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6fd6-fa38-4f68-9873-696a8ebaf43c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.617014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f6fd6-fa38-4f68-9873-696a8ebaf43c admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.617741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6fd6-fa38-4f68-9873-696a8ebaf43c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:54:41.618049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6fd6-fa38-4f68-9873-696a8ebaf43c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:41.620243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f6fd6-fa38-4f68-9873-696a8ebaf43c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:41.631204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1259/2517] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:54:41.636771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc9c93-66f5-45c4-bf50-f6e0db4cc6ee None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:41.646217 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc9c93-66f5-45c4-bf50-f6e0db4cc6ee None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:41.650909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15983424-39e4-46a0-a0a7-158a445b113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:41.651554 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15983424-39e4-46a0-a0a7-158a445b113d admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.651860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15983424-39e4-46a0-a0a7-158a445b113d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.652136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15983424-39e4-46a0-a0a7-158a445b113d admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.652865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15983424-39e4-46a0-a0a7-158a445b113d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:41.654865 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15983424-39e4-46a0-a0a7-158a445b113d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:41.679629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1259/2518] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:54:41 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:54:41.684609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f6fd6-fa38-4f68-9873-696a8ebaf43c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:41.695446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f6fd6-fa38-4f68-9873-696a8ebaf43c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:41.750195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17579fd6-f558-423b-882d-32ef8b96a5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:41.750874 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17579fd6-f558-423b-882d-32ef8b96a5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.751158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17579fd6-f558-423b-882d-32ef8b96a5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.751468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17579fd6-f558-423b-882d-32ef8b96a5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.752249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17579fd6-f558-423b-882d-32ef8b96a5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:41.754224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17579fd6-f558-423b-882d-32ef8b96a5a5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:41.775832 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1260/2519] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:54:41 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:54:41.779949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15983424-39e4-46a0-a0a7-158a445b113d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:41.790641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15983424-39e4-46a0-a0a7-158a445b113d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:41.795501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b5bc1-fce6-427f-b2b0-76e9ebf9ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:41.796316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b5bc1-fce6-427f-b2b0-76e9ebf9ff3b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.796675 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b5bc1-fce6-427f-b2b0-76e9ebf9ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.797048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b5bc1-fce6-427f-b2b0-76e9ebf9ff3b admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.797874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b5bc1-fce6-427f-b2b0-76e9ebf9ff3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:41.799561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b5bc1-fce6-427f-b2b0-76e9ebf9ff3b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:41.811323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1260/2520] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:54:41.815407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17579fd6-f558-423b-882d-32ef8b96a5a5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:41.826240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17579fd6-f558-423b-882d-32ef8b96a5a5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:41.831020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbaf3e-4693-40f6-9d4b-9de7a57c9a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:41.831733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbaf3e-4693-40f6-9d4b-9de7a57c9a47 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.832018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbaf3e-4693-40f6-9d4b-9de7a57c9a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.832298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbaf3e-4693-40f6-9d4b-9de7a57c9a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.833046 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbaf3e-4693-40f6-9d4b-9de7a57c9a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:41.834684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcbaf3e-4693-40f6-9d4b-9de7a57c9a47 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:41.845400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1261/2521] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:54:41.849527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b5bc1-fce6-427f-b2b0-76e9ebf9ff3b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:41.859619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b5bc1-fce6-427f-b2b0-76e9ebf9ff3b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:41.864301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b33deb-7a3d-4709-8a10-232f758b6df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:41.865203 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33deb-7a3d-4709-8a10-232f758b6df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.865490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33deb-7a3d-4709-8a10-232f758b6df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.865772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b33deb-7a3d-4709-8a10-232f758b6df2 admin admin] PATH_INFO: `/v3/projects/4d8774be86e84ff7a66787d6f67c554e/users/6bf586d36da74c29ab1a188bb6da8603/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.881287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b33deb-7a3d-4709-8a10-232f758b6df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8774be86e84ff7a66787d6f67c554e, user_id=6bf586d36da74c29ab1a188bb6da8603, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:41.883971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b33deb-7a3d-4709-8a10-232f758b6df2 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:41.897728 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1261/2522] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:54:41 2022] PUT /identity/v3/projects/4d8774be86e84ff7a66787d6f67c554e/users/6bf586d36da74c29ab1a188bb6da8603/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:54:41.902812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29275f45-85c9-41a9-a155-fd9ae6588c05 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:41.903339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29275f45-85c9-41a9-a155-fd9ae6588c05 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:41.903605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29275f45-85c9-41a9-a155-fd9ae6588c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:41.921992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-29275f45-85c9-41a9-a155-fd9ae6588c05 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:41.923202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-29275f45-85c9-41a9-a155-fd9ae6588c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:41.981340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1262/2523] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:41.990740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b33deb-7a3d-4709-8a10-232f758b6df2 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:41.992735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f5b33deb-7a3d-4709-8a10-232f758b6df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:42.053054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b33deb-7a3d-4709-8a10-232f758b6df2 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:42.057386 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17937-22b4-4140-b26a-fdd87ee73f16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:42.058060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17937-22b4-4140-b26a-fdd87ee73f16 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:42.058369 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17937-22b4-4140-b26a-fdd87ee73f16 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:42.058647 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17937-22b4-4140-b26a-fdd87ee73f16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:42.067459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c17937-22b4-4140-b26a-fdd87ee73f16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:42.068923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c17937-22b4-4140-b26a-fdd87ee73f16 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:42.078137 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1262/2524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:54:45.989665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436aec4-cfb9-4b3f-a2e6-e1ccf1efa003 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:45.990122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436aec4-cfb9-4b3f-a2e6-e1ccf1efa003 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:45.990231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436aec4-cfb9-4b3f-a2e6-e1ccf1efa003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:46.017755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1436aec4-cfb9-4b3f-a2e6-e1ccf1efa003 None None] MFA Rules not processed for user `6bf586d36da74c29ab1a188bb6da8603`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:46.018653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1436aec4-cfb9-4b3f-a2e6-e1ccf1efa003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:46.082197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1263/2525] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:46.086820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17937-22b4-4140-b26a-fdd87ee73f16 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:46.096666 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c17937-22b4-4140-b26a-fdd87ee73f16 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:46.102151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f15b08-675a-44dc-9bf9-5f2899be93ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:46.102808 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f15b08-675a-44dc-9bf9-5f2899be93ce admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:46.103903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f15b08-675a-44dc-9bf9-5f2899be93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:46.104452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f15b08-675a-44dc-9bf9-5f2899be93ce admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:46.104721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f15b08-675a-44dc-9bf9-5f2899be93ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:46.106688 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f15b08-675a-44dc-9bf9-5f2899be93ce admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:46.134982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1263/2526] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:54:46 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:54:46.136305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436aec4-cfb9-4b3f-a2e6-e1ccf1efa003 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:46.149367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436aec4-cfb9-4b3f-a2e6-e1ccf1efa003 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:46.205845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e106214-a9f2-4851-b6aa-e0b4e6ac88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:46.206536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e106214-a9f2-4851-b6aa-e0b4e6ac88b5 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:46.206821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e106214-a9f2-4851-b6aa-e0b4e6ac88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:46.207097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e106214-a9f2-4851-b6aa-e0b4e6ac88b5 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:46.207867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e106214-a9f2-4851-b6aa-e0b4e6ac88b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:46.209781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e106214-a9f2-4851-b6aa-e0b4e6ac88b5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:46.231419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1264/2527] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:54:46 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:54:46.235423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f15b08-675a-44dc-9bf9-5f2899be93ce admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:46.246177 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f15b08-675a-44dc-9bf9-5f2899be93ce admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:46.250771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0897-e6e6-45b6-880a-5efda47f94c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:46.251458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0897-e6e6-45b6-880a-5efda47f94c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:46.251775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0897-e6e6-45b6-880a-5efda47f94c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:46.252059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c0897-e6e6-45b6-880a-5efda47f94c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:46.252797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c0897-e6e6-45b6-880a-5efda47f94c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:46.254399 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c0897-e6e6-45b6-880a-5efda47f94c7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:46.265416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1264/2528] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:54:46.269528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e106214-a9f2-4851-b6aa-e0b4e6ac88b5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:46.282595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e106214-a9f2-4851-b6aa-e0b4e6ac88b5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:46.287425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd57068-50a0-4ad9-8105-bb858a476803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:46.288361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57068-50a0-4ad9-8105-bb858a476803 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:46.288646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57068-50a0-4ad9-8105-bb858a476803 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:46.288926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd57068-50a0-4ad9-8105-bb858a476803 admin admin] PATH_INFO: `/v3/projects/e228d95db50745c9ac65952bd8aad0ec/users/189f725f8af144439a6f27d02914feae/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:46.305347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd57068-50a0-4ad9-8105-bb858a476803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e228d95db50745c9ac65952bd8aad0ec, user_id=189f725f8af144439a6f27d02914feae, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:46.308192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd57068-50a0-4ad9-8105-bb858a476803 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:46.338872 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1265/2529] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:54:46 2022] PUT /identity/v3/projects/e228d95db50745c9ac65952bd8aad0ec/users/189f725f8af144439a6f27d02914feae/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:46.342778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0897-e6e6-45b6-880a-5efda47f94c7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:46.354360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c0897-e6e6-45b6-880a-5efda47f94c7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:46.415673 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f34ed-7d58-4e5c-9ba8-3482a9f23cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:46.416965 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f34ed-7d58-4e5c-9ba8-3482a9f23cab admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:46.417331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f34ed-7d58-4e5c-9ba8-3482a9f23cab admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:46.417681 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f34ed-7d58-4e5c-9ba8-3482a9f23cab admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:46.418537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f34ed-7d58-4e5c-9ba8-3482a9f23cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:46.420190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f34ed-7d58-4e5c-9ba8-3482a9f23cab admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:46.430717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1265/2530] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:54:46.435050 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd57068-50a0-4ad9-8105-bb858a476803 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:46.445653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd57068-50a0-4ad9-8105-bb858a476803 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:46.451165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047be7e-81b3-4d2c-b069-b0075adefb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:46.452097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047be7e-81b3-4d2c-b069-b0075adefb4c admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:46.452378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047be7e-81b3-4d2c-b069-b0075adefb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:46.452652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047be7e-81b3-4d2c-b069-b0075adefb4c admin admin] PATH_INFO: `/v3/projects/e228d95db50745c9ac65952bd8aad0ec/users/189f725f8af144439a6f27d02914feae/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:46.454656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047be7e-81b3-4d2c-b069-b0075adefb4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e228d95db50745c9ac65952bd8aad0ec, user_id=189f725f8af144439a6f27d02914feae, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:46.457355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047be7e-81b3-4d2c-b069-b0075adefb4c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:46.472859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1266/2531] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:54:46 2022] PUT /identity/v3/projects/e228d95db50745c9ac65952bd8aad0ec/users/189f725f8af144439a6f27d02914feae/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:54:51.567213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558612-d8d9-4b3a-b933-e911d5d7197e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:51.567795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558612-d8d9-4b3a-b933-e911d5d7197e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:51.567947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2558612-d8d9-4b3a-b933-e911d5d7197e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:51.606903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-f2558612-d8d9-4b3a-b933-e911d5d7197e None None] MFA Rules not processed for user `189f725f8af144439a6f27d02914feae`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:54:51.608506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f2558612-d8d9-4b3a-b933-e911d5d7197e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:51.700448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1266/2532] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:54:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:54:51.713623 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047be7e-81b3-4d2c-b069-b0075adefb4c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:54:51.715758 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8047be7e-81b3-4d2c-b069-b0075adefb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:54:51.801280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047be7e-81b3-4d2c-b069-b0075adefb4c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:54:51.807543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72551e8a-a2e8-4d88-a3b7-4df4b56c0e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:54:51.808751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72551e8a-a2e8-4d88-a3b7-4df4b56c0e68 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:54:51.809174 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72551e8a-a2e8-4d88-a3b7-4df4b56c0e68 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:54:51.809461 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72551e8a-a2e8-4d88-a3b7-4df4b56c0e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:54:51.867486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72551e8a-a2e8-4d88-a3b7-4df4b56c0e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:54:51.869194 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72551e8a-a2e8-4d88-a3b7-4df4b56c0e68 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:54:51.880133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1267/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:54:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:55:08.468372 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4514f3a-4303-4400-a292-8e1241270a99 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:08.468812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4514f3a-4303-4400-a292-8e1241270a99 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:08.469096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4514f3a-4303-4400-a292-8e1241270a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:08.487462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-f4514f3a-4303-4400-a292-8e1241270a99 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:55:08.488686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f4514f3a-4303-4400-a292-8e1241270a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:08.551782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1267/2534] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jan 27 16:55:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:55:08.574531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72551e8a-a2e8-4d88-a3b7-4df4b56c0e68 service nova] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:08.576177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-72551e8a-a2e8-4d88-a3b7-4df4b56c0e68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:08.659250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72551e8a-a2e8-4d88-a3b7-4df4b56c0e68 service nova] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:08.664144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098c7e83-2c81-4f4e-ab07-7e02571ff972 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:08.664785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7e83-2c81-4f4e-ab07-7e02571ff972 service swift] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:08.665064 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7e83-2c81-4f4e-ab07-7e02571ff972 service swift] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:08.665921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c7e83-2c81-4f4e-ab07-7e02571ff972 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:08.673976 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c7e83-2c81-4f4e-ab07-7e02571ff972 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:08.675527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098c7e83-2c81-4f4e-ab07-7e02571ff972 service swift] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:08.683550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1268/2535] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:55:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:55:09.769630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583059eb-1a31-457e-b0b3-d01c5a35f2b8 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:09.770166 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583059eb-1a31-457e-b0b3-d01c5a35f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:09.770418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583059eb-1a31-457e-b0b3-d01c5a35f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:09.787958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-583059eb-1a31-457e-b0b3-d01c5a35f2b8 None None] MFA Rules not processed for user `6bf586d36da74c29ab1a188bb6da8603`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:55:09.789161 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-583059eb-1a31-457e-b0b3-d01c5a35f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:09.796044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1268/2536] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:55:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:55:12.641122 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693aaf9-6f34-4336-bff7-64f667caed14 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:12.641639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693aaf9-6f34-4336-bff7-64f667caed14 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:12.641728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693aaf9-6f34-4336-bff7-64f667caed14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:12.698856 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b693aaf9-6f34-4336-bff7-64f667caed14 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:55:12.701732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b693aaf9-6f34-4336-bff7-64f667caed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:12.726255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1269/2537] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:55:12.744433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583059eb-1a31-457e-b0b3-d01c5a35f2b8 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:12.767147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583059eb-1a31-457e-b0b3-d01c5a35f2b8 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:12.773383 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e7f7a-9964-4298-bc0b-fbb2d3616cb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:12.775545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7f7a-9964-4298-bc0b-fbb2d3616cb1 service swift] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:12.776168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7f7a-9964-4298-bc0b-fbb2d3616cb1 service swift] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:12.777781 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e7f7a-9964-4298-bc0b-fbb2d3616cb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:12.800632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e7f7a-9964-4298-bc0b-fbb2d3616cb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:12.805548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e7f7a-9964-4298-bc0b-fbb2d3616cb1 service swift] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:12.828534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1269/2538] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:55:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:55:18.819033 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693aaf9-6f34-4336-bff7-64f667caed14 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:18.824153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b693aaf9-6f34-4336-bff7-64f667caed14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:18.905129 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693aaf9-6f34-4336-bff7-64f667caed14 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:18.912929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:18.913864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:18.914156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:18.914436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] PATH_INFO: `/v3/users/f949c79110dd4ceaa532c18230e00a38` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:18.916324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f949c79110dd4ceaa532c18230e00a38)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:18.918262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:18.976062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f949c79110dd4ceaa532c18230e00a38'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:18.983702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f949c79110dd4ceaa532c18230e00a38'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:18.984397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f949c79110dd4ceaa532c18230e00a38'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:18.999153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f949c79110dd4ceaa532c18230e00a38'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.009815 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f949c79110dd4ceaa532c18230e00a38'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.023843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1270/2539] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:55:18 2022] DELETE /identity/v3/users/f949c79110dd4ceaa532c18230e00a38 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:55:19.264379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e7f7a-9964-4298-bc0b-fbb2d3616cb1 service swift] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:19.279115 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e7f7a-9964-4298-bc0b-fbb2d3616cb1 service swift] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:19.382187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:19.383250 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:19.383904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:19.383904 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] PATH_INFO: `/v3/projects/fe08ade68b284511b92c42fba70f29d3` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:19.385937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe08ade68b284511b92c42fba70f29d3)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:19.388106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:19.441242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe08ade68b284511b92c42fba70f29d3', 'request_id': 'req-8b78ab2c-0c36-4598-a43e-4045d1bd6839'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.449503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe08ade68b284511b92c42fba70f29d3', 'request_id': 'req-8b78ab2c-0c36-4598-a43e-4045d1bd6839'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.456489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe08ade68b284511b92c42fba70f29d3', 'request_id': 'req-8b78ab2c-0c36-4598-a43e-4045d1bd6839'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.471153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] The token cache is being invalidate because project fe08ade68b284511b92c42fba70f29d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:55:19.472083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.472207 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.474287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1270/2540] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:55:19 2022] DELETE /identity/v3/projects/fe08ade68b284511b92c42fba70f29d3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:55:19.478045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:19.480233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:19.498914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f568d-cd48-45a1-8273-a5890033aa55 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:19.590591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:19.591787 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:19.592472 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:19.592761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] PATH_INFO: `/v3/users/6e76928bff904d77b8a0e03170930502` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:19.595310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e76928bff904d77b8a0e03170930502)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:19.597764 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:19.673471 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e76928bff904d77b8a0e03170930502'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.681411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e76928bff904d77b8a0e03170930502'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.682116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e76928bff904d77b8a0e03170930502'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.698425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e76928bff904d77b8a0e03170930502'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.723640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e76928bff904d77b8a0e03170930502'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:19.735075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1271/2541] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:55:19 2022] DELETE /identity/v3/users/6e76928bff904d77b8a0e03170930502 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:55:20.007362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:20.009775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:20.040284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b78ab2c-0c36-4598-a43e-4045d1bd6839 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:20.110805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:20.111710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:20.112000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:20.112283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] PATH_INFO: `/v3/projects/3814dcff748c42e4889966e4502af247` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:20.113505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3814dcff748c42e4889966e4502af247)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:20.115845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:20.171852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3814dcff748c42e4889966e4502af247', 'request_id': 'req-a1b16085-7074-44e8-90c6-895f15c4ccfa'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:20.179295 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3814dcff748c42e4889966e4502af247', 'request_id': 'req-a1b16085-7074-44e8-90c6-895f15c4ccfa'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:20.185431 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3814dcff748c42e4889966e4502af247', 'request_id': 'req-a1b16085-7074-44e8-90c6-895f15c4ccfa'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:20.200259 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] The token cache is being invalidate because project 3814dcff748c42e4889966e4502af247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:55:20.200621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:20.201342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-a1b16085-7074-44e8-90c6-895f15c4ccfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:20.203295 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1271/2542] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:55:20 2022] DELETE /identity/v3/projects/3814dcff748c42e4889966e4502af247 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:55:28.483501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:28.485013 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:28.541807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84507f5-2bfa-42e8-8e24-a959f595df1b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:28.598699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:28.599110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:28.599358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:28.599672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:28.601507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:28.674249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:28.675819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:28.687232 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1272/2543] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:55:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:55:30.291744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05755b1e-699c-4fb9-a224-36c446277975 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:30.292249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05755b1e-699c-4fb9-a224-36c446277975 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:30.292361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05755b1e-699c-4fb9-a224-36c446277975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:30.310456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-05755b1e-699c-4fb9-a224-36c446277975 None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:55:30.311699 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-05755b1e-699c-4fb9-a224-36c446277975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:30.366032 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1272/2544] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jan 27 16:55:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:55:30.378748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:30.380821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:30.450836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25615e09-7eca-46c2-8af5-46b289448107 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:30.456573 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7c51-715e-4757-a81d-ddb0b15835e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:30.457238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7c51-715e-4757-a81d-ddb0b15835e7 service swift] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:30.457524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7c51-715e-4757-a81d-ddb0b15835e7 service swift] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:30.457806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a7c51-715e-4757-a81d-ddb0b15835e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:30.467825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a7c51-715e-4757-a81d-ddb0b15835e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:30.469424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a7c51-715e-4757-a81d-ddb0b15835e7 service swift] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:30.477778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1273/2545] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:55:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jan 27 16:55:43.521555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9e10-625a-42fd-bce4-ccfb06c9b04c None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:43.522041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9e10-625a-42fd-bce4-ccfb06c9b04c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:43.522139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dd9e10-625a-42fd-bce4-ccfb06c9b04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:43.540207 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-11dd9e10-625a-42fd-bce4-ccfb06c9b04c None None] MFA Rules not processed for user `531ce85d5104400fa5adec42d30f399b`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:55:43.541407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-11dd9e10-625a-42fd-bce4-ccfb06c9b04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:43.549173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1273/2546] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jan 27 16:55:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:55:43.571646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7c51-715e-4757-a81d-ddb0b15835e7 service swift] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:43.581880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a7c51-715e-4757-a81d-ddb0b15835e7 service swift] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:43.587720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9d588-e8c2-4eb2-b036-07a283832566 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e14c278fc5654bb9ae7c05d4ba023262', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:43.588359 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9d588-e8c2-4eb2-b036-07a283832566 service swift] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:43.588647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9d588-e8c2-4eb2-b036-07a283832566 service swift] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:43.588924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9d588-e8c2-4eb2-b036-07a283832566 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:43.596728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9d588-e8c2-4eb2-b036-07a283832566 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:43.598249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9d588-e8c2-4eb2-b036-07a283832566 service swift] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:43.605942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1274/2547] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jan 27 16:55:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jan 27 16:55:52.024760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9e10-625a-42fd-bce4-ccfb06c9b04c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:52.026151 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-11dd9e10-625a-42fd-bce4-ccfb06c9b04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:52.037148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dd9e10-625a-42fd-bce4-ccfb06c9b04c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:52.041556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520c7a-437d-413c-84ab-559faf108639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:52.042199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520c7a-437d-413c-84ab-559faf108639 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:52.042482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520c7a-437d-413c-84ab-559faf108639 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:52.042760 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520c7a-437d-413c-84ab-559faf108639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:52.044503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-70520c7a-437d-413c-84ab-559faf108639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:52.103929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70520c7a-437d-413c-84ab-559faf108639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:52.105352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70520c7a-437d-413c-84ab-559faf108639 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:52.114614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1274/2548] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:55:55.358929 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9d588-e8c2-4eb2-b036-07a283832566 service swift] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:55.360565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1fb9d588-e8c2-4eb2-b036-07a283832566 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:55.375717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9d588-e8c2-4eb2-b036-07a283832566 service swift] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:55.380284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:55.381169 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:55.382116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:55.382487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] PATH_INFO: `/v3/users/20137a83d3de4dcfaba05ab93c470829` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:55.383821 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=20137a83d3de4dcfaba05ab93c470829)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:55.385776 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:55.436049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20137a83d3de4dcfaba05ab93c470829'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.442911 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20137a83d3de4dcfaba05ab93c470829'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.443773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20137a83d3de4dcfaba05ab93c470829'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.456354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20137a83d3de4dcfaba05ab93c470829'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.464800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-cfa64065-665c-403e-8fce-527e670be28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20137a83d3de4dcfaba05ab93c470829'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.471370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1275/2549] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:55:55 2022] DELETE /identity/v3/users/20137a83d3de4dcfaba05ab93c470829 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:55:55.644211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520c7a-437d-413c-84ab-559faf108639 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:55.655436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520c7a-437d-413c-84ab-559faf108639 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:55.711505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:55.712325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:55.712612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:55.712893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] PATH_INFO: `/v3/projects/accb650bdbfa4de4a4129fd473ca736d` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:55.714083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=accb650bdbfa4de4a4129fd473ca736d)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:55.716016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:55.759764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accb650bdbfa4de4a4129fd473ca736d', 'request_id': 'req-af38f1a9-4e8f-4483-98f0-8ff301be68ba'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.765854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accb650bdbfa4de4a4129fd473ca736d', 'request_id': 'req-af38f1a9-4e8f-4483-98f0-8ff301be68ba'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.770985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accb650bdbfa4de4a4129fd473ca736d', 'request_id': 'req-af38f1a9-4e8f-4483-98f0-8ff301be68ba'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.783033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] The token cache is being invalidate because project accb650bdbfa4de4a4129fd473ca736d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:55:55.783325 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.783962 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af38f1a9-4e8f-4483-98f0-8ff301be68ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:55:55.785476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1275/2550] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:55:55 2022] DELETE /identity/v3/projects/accb650bdbfa4de4a4129fd473ca736d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:55:55.791802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6165e5-fc31-473b-87b2-dbca87916a00 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:55.792113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6165e5-fc31-473b-87b2-dbca87916a00 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:55.792392 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6165e5-fc31-473b-87b2-dbca87916a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:55.810181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-9b6165e5-fc31-473b-87b2-dbca87916a00 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:55:55.811360 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9b6165e5-fc31-473b-87b2-dbca87916a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:55.867500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1276/2551] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:55:55.875606 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d793ff-44cb-4584-adb9-ea8fc9d9c73b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:55.875903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d793ff-44cb-4584-adb9-ea8fc9d9c73b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:55.876189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d793ff-44cb-4584-adb9-ea8fc9d9c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:55.894655 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-98d793ff-44cb-4584-adb9-ea8fc9d9c73b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:55:55.895888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-98d793ff-44cb-4584-adb9-ea8fc9d9c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:55.904552 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1276/2552] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:55:55.908714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6165e5-fc31-473b-87b2-dbca87916a00 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:55.922039 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6165e5-fc31-473b-87b2-dbca87916a00 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:55.928785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb0542-7217-4c00-ac53-30edfc4fb495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:55.929674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb0542-7217-4c00-ac53-30edfc4fb495 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:55.929977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb0542-7217-4c00-ac53-30edfc4fb495 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:55.930228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb0542-7217-4c00-ac53-30edfc4fb495 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:55.930965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb0542-7217-4c00-ac53-30edfc4fb495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:55:55.931267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb0542-7217-4c00-ac53-30edfc4fb495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:55.933609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb0542-7217-4c00-ac53-30edfc4fb495 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:55.946252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1277/2553] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:55:55.950625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d793ff-44cb-4584-adb9-ea8fc9d9c73b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:55.961311 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d793ff-44cb-4584-adb9-ea8fc9d9c73b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:55.966055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd5b7c-6f9d-4762-b00a-f1895e070413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:55.966643 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd5b7c-6f9d-4762-b00a-f1895e070413 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:55.966929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd5b7c-6f9d-4762-b00a-f1895e070413 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:55.967208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd5b7c-6f9d-4762-b00a-f1895e070413 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:55.967934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd5b7c-6f9d-4762-b00a-f1895e070413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:55.969828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd5b7c-6f9d-4762-b00a-f1895e070413 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:56.003510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1277/2554] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:55:55 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:55:56.008651 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb0542-7217-4c00-ac53-30edfc4fb495 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:56.020463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb0542-7217-4c00-ac53-30edfc4fb495 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:56.088104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6bf21-7df6-40cf-bb69-c8bf64ac6f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:56.089220 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6bf21-7df6-40cf-bb69-c8bf64ac6f60 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:56.089714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6bf21-7df6-40cf-bb69-c8bf64ac6f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:56.090204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6bf21-7df6-40cf-bb69-c8bf64ac6f60 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:56.091494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6bf21-7df6-40cf-bb69-c8bf64ac6f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:56.094999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a6bf21-7df6-40cf-bb69-c8bf64ac6f60 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:56.118017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1278/2555] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:55:56 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:55:56.122520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd5b7c-6f9d-4762-b00a-f1895e070413 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:56.132598 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd5b7c-6f9d-4762-b00a-f1895e070413 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:56.137779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec9c11-99c8-4088-b968-6c1504ca2410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:56.138441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec9c11-99c8-4088-b968-6c1504ca2410 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:56.138738 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec9c11-99c8-4088-b968-6c1504ca2410 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:56.138999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec9c11-99c8-4088-b968-6c1504ca2410 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:56.140622 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec9c11-99c8-4088-b968-6c1504ca2410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:56.142244 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec9c11-99c8-4088-b968-6c1504ca2410 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:56.153482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1278/2556] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:55:56.157740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6bf21-7df6-40cf-bb69-c8bf64ac6f60 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:56.172670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6bf21-7df6-40cf-bb69-c8bf64ac6f60 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:56.178121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678fd34-d690-4467-8986-fc82d473955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:56.179040 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678fd34-d690-4467-8986-fc82d473955e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:56.179319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678fd34-d690-4467-8986-fc82d473955e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:56.179617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678fd34-d690-4467-8986-fc82d473955e admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:56.180362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678fd34-d690-4467-8986-fc82d473955e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:56.181974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678fd34-d690-4467-8986-fc82d473955e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:56.192810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1279/2557] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:55:56.198641 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec9c11-99c8-4088-b968-6c1504ca2410 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:56.208519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec9c11-99c8-4088-b968-6c1504ca2410 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:56.213823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3a89c-954a-4b17-a4ca-85f0720fb685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:56.214700 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3a89c-954a-4b17-a4ca-85f0720fb685 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:56.214982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3a89c-954a-4b17-a4ca-85f0720fb685 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:56.215260 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3a89c-954a-4b17-a4ca-85f0720fb685 admin admin] PATH_INFO: `/v3/projects/cb3bb30d61ef49a38afc608570a23185/users/5dbb1094a42948d5beea947427f4460f/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:56.230104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3a89c-954a-4b17-a4ca-85f0720fb685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb3bb30d61ef49a38afc608570a23185, user_id=5dbb1094a42948d5beea947427f4460f, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:56.232792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3a89c-954a-4b17-a4ca-85f0720fb685 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:56.246928 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1279/2558] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:55:56 2022] PUT /identity/v3/projects/cb3bb30d61ef49a38afc608570a23185/users/5dbb1094a42948d5beea947427f4460f/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:55:56.260369 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d8544-53bd-497e-93be-5ff5fd6f60ed None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:56.260663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d8544-53bd-497e-93be-5ff5fd6f60ed None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:56.260942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d8544-53bd-497e-93be-5ff5fd6f60ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:56.293731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-902d8544-53bd-497e-93be-5ff5fd6f60ed None None] MFA Rules not processed for user `5dbb1094a42948d5beea947427f4460f`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:55:56.295145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-902d8544-53bd-497e-93be-5ff5fd6f60ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:56.366714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1280/2559] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:55:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:55:56.378031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3a89c-954a-4b17-a4ca-85f0720fb685 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:55:56.379811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-4ac3a89c-954a-4b17-a4ca-85f0720fb685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:55:56.462958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3a89c-954a-4b17-a4ca-85f0720fb685 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:55:56.470631 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced04814-9afc-495b-94dc-5cfdec68035b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:55:56.471277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04814-9afc-495b-94dc-5cfdec68035b service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:55:56.471559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04814-9afc-495b-94dc-5cfdec68035b service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:55:56.471873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced04814-9afc-495b-94dc-5cfdec68035b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:55:56.480339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04814-9afc-495b-94dc-5cfdec68035b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:55:56.481852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced04814-9afc-495b-94dc-5cfdec68035b service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:55:56.493422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1280/2560] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:55:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:03.706994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d8544-53bd-497e-93be-5ff5fd6f60ed None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:03.766515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d8544-53bd-497e-93be-5ff5fd6f60ed None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:03.771011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:03.772528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:03.772810 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:03.773084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] PATH_INFO: `/v3/users/5dbb1094a42948d5beea947427f4460f` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:03.774274 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dbb1094a42948d5beea947427f4460f)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:03.776227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:03.819487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbb1094a42948d5beea947427f4460f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:03.825688 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbb1094a42948d5beea947427f4460f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:03.826342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbb1094a42948d5beea947427f4460f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:03.838098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbb1094a42948d5beea947427f4460f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:03.844751 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbb1094a42948d5beea947427f4460f'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:03.850569 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1281/2561] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:03 2022] DELETE /identity/v3/users/5dbb1094a42948d5beea947427f4460f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:03.855069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2623ef-2762-4faf-a4d7-0e59a631db9f None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:03.855559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2623ef-2762-4faf-a4d7-0e59a631db9f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:03.855698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2623ef-2762-4faf-a4d7-0e59a631db9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:03.872850 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-9d2623ef-2762-4faf-a4d7-0e59a631db9f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:03.874035 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9d2623ef-2762-4faf-a4d7-0e59a631db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:03.931205 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1281/2562] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:03.941090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:03.942521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:03.997109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39353b8-0c50-4c2a-88c6-4872dd0632a0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:04.000741 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0630-b147-4d09-a159-9a4f211c737e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:04.001387 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0630-b147-4d09-a159-9a4f211c737e service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.001681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0630-b147-4d09-a159-9a4f211c737e service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.001957 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0630-b147-4d09-a159-9a4f211c737e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.011525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a0630-b147-4d09-a159-9a4f211c737e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:04.012973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a0630-b147-4d09-a159-9a4f211c737e service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:04.022765 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1282/2563] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:04.273645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2623ef-2762-4faf-a4d7-0e59a631db9f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:04.275164 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-9d2623ef-2762-4faf-a4d7-0e59a631db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:04.289117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2623ef-2762-4faf-a4d7-0e59a631db9f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:04.293804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:04.295333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.295822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.296117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] PATH_INFO: `/v3/projects/cb3bb30d61ef49a38afc608570a23185` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.297516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb3bb30d61ef49a38afc608570a23185)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:04.299345 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:04.344930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb3bb30d61ef49a38afc608570a23185', 'request_id': 'req-936167f4-5e63-42e5-ba5a-d2060baf2f4b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:04.352298 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb3bb30d61ef49a38afc608570a23185', 'request_id': 'req-936167f4-5e63-42e5-ba5a-d2060baf2f4b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:04.357637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb3bb30d61ef49a38afc608570a23185', 'request_id': 'req-936167f4-5e63-42e5-ba5a-d2060baf2f4b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:04.369218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] The token cache is being invalidate because project cb3bb30d61ef49a38afc608570a23185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:04.369467 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:04.370076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-936167f4-5e63-42e5-ba5a-d2060baf2f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:04.371625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1282/2564] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:04 2022] DELETE /identity/v3/projects/cb3bb30d61ef49a38afc608570a23185 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:04.377243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832dbf4-3715-4f6c-ab01-003b871188c7 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.377536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832dbf4-3715-4f6c-ab01-003b871188c7 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.377818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832dbf4-3715-4f6c-ab01-003b871188c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.397206 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-7832dbf4-3715-4f6c-ab01-003b871188c7 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:04.398415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-7832dbf4-3715-4f6c-ab01-003b871188c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:04.579661 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1283/2565] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:04.588234 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf1160-6949-462b-8d41-f0dce367137e None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.588531 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf1160-6949-462b-8d41-f0dce367137e None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.588820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf1160-6949-462b-8d41-f0dce367137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.606676 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-a8cf1160-6949-462b-8d41-f0dce367137e None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:04.607909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a8cf1160-6949-462b-8d41-f0dce367137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:04.615820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1283/2566] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:04.619893 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832dbf4-3715-4f6c-ab01-003b871188c7 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:04.629154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832dbf4-3715-4f6c-ab01-003b871188c7 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:04.634371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d424-cbbc-4b19-a714-9132f539c35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:04.635081 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d424-cbbc-4b19-a714-9132f539c35b admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.635363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d424-cbbc-4b19-a714-9132f539c35b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.635669 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9d424-cbbc-4b19-a714-9132f539c35b admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.636673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9d424-cbbc-4b19-a714-9132f539c35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:04.636999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9d424-cbbc-4b19-a714-9132f539c35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:04.638609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9d424-cbbc-4b19-a714-9132f539c35b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:04.650894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1284/2567] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:56:04.655088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf1160-6949-462b-8d41-f0dce367137e None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:04.664469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf1160-6949-462b-8d41-f0dce367137e None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:04.669709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132a3f1-f175-4d4b-836a-fc4aae94e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:04.670368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132a3f1-f175-4d4b-836a-fc4aae94e462 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.670658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132a3f1-f175-4d4b-836a-fc4aae94e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.670939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132a3f1-f175-4d4b-836a-fc4aae94e462 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.671684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132a3f1-f175-4d4b-836a-fc4aae94e462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:04.673599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132a3f1-f175-4d4b-836a-fc4aae94e462 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:04.703429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1284/2568] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:04 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:04.704637 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d424-cbbc-4b19-a714-9132f539c35b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:04.714884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9d424-cbbc-4b19-a714-9132f539c35b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:04.766555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4161-8437-4cd8-9af8-4e725c4aaefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:04.767205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4161-8437-4cd8-9af8-4e725c4aaefa admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.767482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4161-8437-4cd8-9af8-4e725c4aaefa admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.767783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c4161-8437-4cd8-9af8-4e725c4aaefa admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.768473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c4161-8437-4cd8-9af8-4e725c4aaefa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:04.770343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c4161-8437-4cd8-9af8-4e725c4aaefa admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:04.789985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1285/2569] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:04 2022] POST /identity/v3/users => generated 279 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:04.794010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132a3f1-f175-4d4b-836a-fc4aae94e462 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:04.804395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132a3f1-f175-4d4b-836a-fc4aae94e462 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:04.808924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c4c26-d205-4185-856f-4e1f3577da6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:04.809570 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4c26-d205-4185-856f-4e1f3577da6b admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.809852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4c26-d205-4185-856f-4e1f3577da6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.810130 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c4c26-d205-4185-856f-4e1f3577da6b admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.810866 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c4c26-d205-4185-856f-4e1f3577da6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:04.812485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c4c26-d205-4185-856f-4e1f3577da6b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:04.823020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1285/2570] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:04.826793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4161-8437-4cd8-9af8-4e725c4aaefa admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:04.836648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c4161-8437-4cd8-9af8-4e725c4aaefa admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:04.841223 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc44a7-6df1-4f08-a6b7-b446b64f63d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:04.841878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc44a7-6df1-4f08-a6b7-b446b64f63d7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.842159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc44a7-6df1-4f08-a6b7-b446b64f63d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.842435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc44a7-6df1-4f08-a6b7-b446b64f63d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.843162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc44a7-6df1-4f08-a6b7-b446b64f63d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:04.844773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc44a7-6df1-4f08-a6b7-b446b64f63d7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:04.854465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1286/2571] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:04.858257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c4c26-d205-4185-856f-4e1f3577da6b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:04.868599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c4c26-d205-4185-856f-4e1f3577da6b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:04.873398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ab8a3-f3bf-467b-9c8e-6b15f5a545ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:04.874193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ab8a3-f3bf-467b-9c8e-6b15f5a545ee admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.874474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ab8a3-f3bf-467b-9c8e-6b15f5a545ee admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.874752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ab8a3-f3bf-467b-9c8e-6b15f5a545ee admin admin] PATH_INFO: `/v3/projects/407deb24a3a347e5a6ea72f91a22223d/users/e0de01c1100145e49c03e2f711ae7ca6/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.889947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ab8a3-f3bf-467b-9c8e-6b15f5a545ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=407deb24a3a347e5a6ea72f91a22223d, user_id=e0de01c1100145e49c03e2f711ae7ca6, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:04.892636 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ab8a3-f3bf-467b-9c8e-6b15f5a545ee admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:04.905619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1286/2572] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:04 2022] PUT /identity/v3/projects/407deb24a3a347e5a6ea72f91a22223d/users/e0de01c1100145e49c03e2f711ae7ca6/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:04.916092 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699bfd-1c5e-4fd4-95e6-c630124c2be4 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:04.916379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699bfd-1c5e-4fd4-95e6-c630124c2be4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:04.916656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2699bfd-1c5e-4fd4-95e6-c630124c2be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:04.942389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d2699bfd-1c5e-4fd4-95e6-c630124c2be4 None None] MFA Rules not processed for user `e0de01c1100145e49c03e2f711ae7ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:04.944336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d2699bfd-1c5e-4fd4-95e6-c630124c2be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:05.003672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1287/2573] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:05.008719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ab8a3-f3bf-467b-9c8e-6b15f5a545ee admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:05.070316 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ab8a3-f3bf-467b-9c8e-6b15f5a545ee admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:05.074908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41624f39-95d4-474f-bc07-9d74bfb53664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:05.075559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41624f39-95d4-474f-bc07-9d74bfb53664 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:05.075870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41624f39-95d4-474f-bc07-9d74bfb53664 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:05.076148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41624f39-95d4-474f-bc07-9d74bfb53664 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:05.076843 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41624f39-95d4-474f-bc07-9d74bfb53664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:05.078724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41624f39-95d4-474f-bc07-9d74bfb53664 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:05.102803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1287/2574] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:05 2022] POST /identity/v3/projects => generated 355 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:05.106745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699bfd-1c5e-4fd4-95e6-c630124c2be4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:05.117873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2699bfd-1c5e-4fd4-95e6-c630124c2be4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:05.171533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e9210-fc7c-46ed-805a-6d2da5f13907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:05.172150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e9210-fc7c-46ed-805a-6d2da5f13907 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:05.172434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e9210-fc7c-46ed-805a-6d2da5f13907 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:05.172713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e9210-fc7c-46ed-805a-6d2da5f13907 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:05.173425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e9210-fc7c-46ed-805a-6d2da5f13907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:05.175324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e9210-fc7c-46ed-805a-6d2da5f13907 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:05.194370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1288/2575] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:05 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:05.198525 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41624f39-95d4-474f-bc07-9d74bfb53664 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:05.208571 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41624f39-95d4-474f-bc07-9d74bfb53664 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:05.213171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d252b0-4c10-4ba3-b3b6-71fcc01e5525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:05.213827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d252b0-4c10-4ba3-b3b6-71fcc01e5525 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:05.214116 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d252b0-4c10-4ba3-b3b6-71fcc01e5525 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:05.214400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d252b0-4c10-4ba3-b3b6-71fcc01e5525 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:05.215172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d252b0-4c10-4ba3-b3b6-71fcc01e5525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:05.216810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d252b0-4c10-4ba3-b3b6-71fcc01e5525 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:05.227817 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1288/2576] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:05.231851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e9210-fc7c-46ed-805a-6d2da5f13907 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:05.242054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e9210-fc7c-46ed-805a-6d2da5f13907 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:05.246632 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879849d-a5b8-41c3-87b3-39e3831a986d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:05.247494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879849d-a5b8-41c3-87b3-39e3831a986d admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:05.247802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879849d-a5b8-41c3-87b3-39e3831a986d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:05.248077 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879849d-a5b8-41c3-87b3-39e3831a986d admin admin] PATH_INFO: `/v3/projects/0f10be3b119c4884aac55d2d7c0063d4/users/22da2f7cc1154564a7aaf2dd45a921c2/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:05.262389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879849d-a5b8-41c3-87b3-39e3831a986d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f10be3b119c4884aac55d2d7c0063d4, user_id=22da2f7cc1154564a7aaf2dd45a921c2, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:05.265036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879849d-a5b8-41c3-87b3-39e3831a986d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:05.277770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1289/2577] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:05 2022] PUT /identity/v3/projects/0f10be3b119c4884aac55d2d7c0063d4/users/22da2f7cc1154564a7aaf2dd45a921c2/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:05.281642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d252b0-4c10-4ba3-b3b6-71fcc01e5525 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:05.292342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d252b0-4c10-4ba3-b3b6-71fcc01e5525 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:05.345068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2513f44-aef8-4d36-a7cb-7659ccb94535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:05.345729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2513f44-aef8-4d36-a7cb-7659ccb94535 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:05.346015 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2513f44-aef8-4d36-a7cb-7659ccb94535 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:05.346296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2513f44-aef8-4d36-a7cb-7659ccb94535 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:05.347026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2513f44-aef8-4d36-a7cb-7659ccb94535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:05.348638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2513f44-aef8-4d36-a7cb-7659ccb94535 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:05.358358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1289/2578] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:05.362429 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879849d-a5b8-41c3-87b3-39e3831a986d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:05.373476 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879849d-a5b8-41c3-87b3-39e3831a986d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:05.377998 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8236-ab73-4590-8be7-7d875e5a448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:05.378890 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8236-ab73-4590-8be7-7d875e5a448c admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:05.379167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8236-ab73-4590-8be7-7d875e5a448c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:05.379440 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8236-ab73-4590-8be7-7d875e5a448c admin admin] PATH_INFO: `/v3/projects/0f10be3b119c4884aac55d2d7c0063d4/users/22da2f7cc1154564a7aaf2dd45a921c2/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:05.381936 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be8236-ab73-4590-8be7-7d875e5a448c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f10be3b119c4884aac55d2d7c0063d4, user_id=22da2f7cc1154564a7aaf2dd45a921c2, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:05.384568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6be8236-ab73-4590-8be7-7d875e5a448c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:05.394560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1290/2579] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:05 2022] PUT /identity/v3/projects/0f10be3b119c4884aac55d2d7c0063d4/users/22da2f7cc1154564a7aaf2dd45a921c2/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:05.406096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640f89-8640-497a-afa0-13ef9c69cbdc None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:05.406395 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640f89-8640-497a-afa0-13ef9c69cbdc None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:05.406680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74640f89-8640-497a-afa0-13ef9c69cbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:05.432811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-74640f89-8640-497a-afa0-13ef9c69cbdc None None] MFA Rules not processed for user `22da2f7cc1154564a7aaf2dd45a921c2`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:05.433924 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-74640f89-8640-497a-afa0-13ef9c69cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:05.497447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1290/2580] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:05 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:05.507406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8236-ab73-4590-8be7-7d875e5a448c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:05.509095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b6be8236-ab73-4590-8be7-7d875e5a448c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:05.564356 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8236-ab73-4590-8be7-7d875e5a448c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:05.567996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60734-0d6d-4cec-8463-877c019c3805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:05.568681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60734-0d6d-4cec-8463-877c019c3805 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:05.568971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60734-0d6d-4cec-8463-877c019c3805 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:05.569249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b60734-0d6d-4cec-8463-877c019c3805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:05.577978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60734-0d6d-4cec-8463-877c019c3805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:05.579389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b60734-0d6d-4cec-8463-877c019c3805 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:05.589047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1291/2581] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:05 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:05.655528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640f89-8640-497a-afa0-13ef9c69cbdc None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:05.665428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74640f89-8640-497a-afa0-13ef9c69cbdc None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:05.669039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102208a-5b81-448f-9d77-0c16a5307371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:05.669674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102208a-5b81-448f-9d77-0c16a5307371 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:05.669959 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102208a-5b81-448f-9d77-0c16a5307371 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:05.670235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102208a-5b81-448f-9d77-0c16a5307371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:05.724106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102208a-5b81-448f-9d77-0c16a5307371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:05.726208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102208a-5b81-448f-9d77-0c16a5307371 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:05.734697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1291/2582] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:05 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:20.129732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60734-0d6d-4cec-8463-877c019c3805 service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:20.190805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b60734-0d6d-4cec-8463-877c019c3805 service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:20.195389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:20.196291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:20.196612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:20.196886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] PATH_INFO: `/v3/users/e0de01c1100145e49c03e2f711ae7ca6` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:20.198076 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0de01c1100145e49c03e2f711ae7ca6)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:20.200159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:20.245298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0de01c1100145e49c03e2f711ae7ca6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.251867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0de01c1100145e49c03e2f711ae7ca6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.252592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0de01c1100145e49c03e2f711ae7ca6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.264367 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0de01c1100145e49c03e2f711ae7ca6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.271509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0de01c1100145e49c03e2f711ae7ca6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.277389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1292/2583] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:20 2022] DELETE /identity/v3/users/e0de01c1100145e49c03e2f711ae7ca6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:20.281859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7596f4-bf6d-4a72-bbfd-6b7e3783d2a3 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:20.282360 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7596f4-bf6d-4a72-bbfd-6b7e3783d2a3 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:20.282481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7596f4-bf6d-4a72-bbfd-6b7e3783d2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:20.300490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-1f7596f4-bf6d-4a72-bbfd-6b7e3783d2a3 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:20.301694 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-1f7596f4-bf6d-4a72-bbfd-6b7e3783d2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:20.369428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1292/2584] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:20.375503 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:20.377306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:20.460083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a59ad-865f-4ede-b724-306f24e4e757 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:20.464517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316147b-a728-4993-a72e-11486b41250d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:20.465324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316147b-a728-4993-a72e-11486b41250d service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:20.465652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316147b-a728-4993-a72e-11486b41250d service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:20.466053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316147b-a728-4993-a72e-11486b41250d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:20.479352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316147b-a728-4993-a72e-11486b41250d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:20.480919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d316147b-a728-4993-a72e-11486b41250d service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:20.507782 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1293/2585] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:20.804458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7596f4-bf6d-4a72-bbfd-6b7e3783d2a3 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:20.806053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-1f7596f4-bf6d-4a72-bbfd-6b7e3783d2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:20.818736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7596f4-bf6d-4a72-bbfd-6b7e3783d2a3 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:20.824416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:20.825397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:20.825748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:20.826119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] PATH_INFO: `/v3/projects/407deb24a3a347e5a6ea72f91a22223d` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:20.827416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=407deb24a3a347e5a6ea72f91a22223d)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:20.831085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:20.882652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407deb24a3a347e5a6ea72f91a22223d', 'request_id': 'req-269dbfd8-c701-4162-8c1b-d919ba6916d4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.889530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407deb24a3a347e5a6ea72f91a22223d', 'request_id': 'req-269dbfd8-c701-4162-8c1b-d919ba6916d4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.895380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407deb24a3a347e5a6ea72f91a22223d', 'request_id': 'req-269dbfd8-c701-4162-8c1b-d919ba6916d4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.912453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] The token cache is being invalidate because project 407deb24a3a347e5a6ea72f91a22223d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:20.913048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.913864 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:20.915429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1293/2586] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:20 2022] DELETE /identity/v3/projects/407deb24a3a347e5a6ea72f91a22223d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:20.920227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316147b-a728-4993-a72e-11486b41250d service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:20.930819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d316147b-a728-4993-a72e-11486b41250d service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:20.986310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:20.987079 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:20.987362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:20.987677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] PATH_INFO: `/v3/users/22da2f7cc1154564a7aaf2dd45a921c2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:20.988863 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22da2f7cc1154564a7aaf2dd45a921c2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:20.991018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:21.040428 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22da2f7cc1154564a7aaf2dd45a921c2'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.047035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22da2f7cc1154564a7aaf2dd45a921c2'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.047750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22da2f7cc1154564a7aaf2dd45a921c2'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.059363 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22da2f7cc1154564a7aaf2dd45a921c2'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.066337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-48b10667-c88d-4567-b665-dd534fc6dea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22da2f7cc1154564a7aaf2dd45a921c2'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.073222 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1294/2587] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:20 2022] DELETE /identity/v3/users/22da2f7cc1154564a7aaf2dd45a921c2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:21.348209 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:21.350714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:21.364484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269dbfd8-c701-4162-8c1b-d919ba6916d4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:21.425346 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:21.426308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.426665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.427140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] PATH_INFO: `/v3/projects/0f10be3b119c4884aac55d2d7c0063d4` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.428538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f10be3b119c4884aac55d2d7c0063d4)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:21.430547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:21.478920 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f10be3b119c4884aac55d2d7c0063d4', 'request_id': 'req-5c5008f3-f902-4969-926e-972d1b1ae9fc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.484977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f10be3b119c4884aac55d2d7c0063d4', 'request_id': 'req-5c5008f3-f902-4969-926e-972d1b1ae9fc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.491382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f10be3b119c4884aac55d2d7c0063d4', 'request_id': 'req-5c5008f3-f902-4969-926e-972d1b1ae9fc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.506329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] The token cache is being invalidate because project 0f10be3b119c4884aac55d2d7c0063d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:21.506650 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.507291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-5c5008f3-f902-4969-926e-972d1b1ae9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:21.508840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1294/2588] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:21 2022] DELETE /identity/v3/projects/0f10be3b119c4884aac55d2d7c0063d4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:21.515103 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31c368-3335-4d4a-8433-c53cf2e99480 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.515625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31c368-3335-4d4a-8433-c53cf2e99480 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.515726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31c368-3335-4d4a-8433-c53cf2e99480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.533978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6d31c368-3335-4d4a-8433-c53cf2e99480 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:21.535198 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6d31c368-3335-4d4a-8433-c53cf2e99480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:21.600736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1295/2589] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:21.608223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aec7d-9a89-4c8c-acfe-084ec608c393 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.608518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aec7d-9a89-4c8c-acfe-084ec608c393 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.608803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492aec7d-9a89-4c8c-acfe-084ec608c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.630951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-492aec7d-9a89-4c8c-acfe-084ec608c393 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:21.632199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-492aec7d-9a89-4c8c-acfe-084ec608c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:21.640608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1295/2590] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:21.644806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31c368-3335-4d4a-8433-c53cf2e99480 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:21.654338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31c368-3335-4d4a-8433-c53cf2e99480 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:21.659098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b395cc-4030-4e3f-b2d1-993f5708b6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:21.659793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b395cc-4030-4e3f-b2d1-993f5708b6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.660079 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b395cc-4030-4e3f-b2d1-993f5708b6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.660357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b395cc-4030-4e3f-b2d1-993f5708b6d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.661088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b395cc-4030-4e3f-b2d1-993f5708b6d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:21.662019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b395cc-4030-4e3f-b2d1-993f5708b6d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:21.663940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b395cc-4030-4e3f-b2d1-993f5708b6d3 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:21.675411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1296/2591] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:56:21.680475 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aec7d-9a89-4c8c-acfe-084ec608c393 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:21.689885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492aec7d-9a89-4c8c-acfe-084ec608c393 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:21.694710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17593f20-ff5b-45c4-878f-840d54b84207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:21.695438 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17593f20-ff5b-45c4-878f-840d54b84207 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.695826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17593f20-ff5b-45c4-878f-840d54b84207 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.696172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17593f20-ff5b-45c4-878f-840d54b84207 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.697380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17593f20-ff5b-45c4-878f-840d54b84207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:21.699019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17593f20-ff5b-45c4-878f-840d54b84207 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:21.727485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1296/2592] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:21 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:21.728704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b395cc-4030-4e3f-b2d1-993f5708b6d3 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:21.738873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b395cc-4030-4e3f-b2d1-993f5708b6d3 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:21.792986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be368-3c04-4b6e-a201-73e35c5b8578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:21.793650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be368-3c04-4b6e-a201-73e35c5b8578 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.793959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be368-3c04-4b6e-a201-73e35c5b8578 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.794287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be368-3c04-4b6e-a201-73e35c5b8578 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.794993 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143be368-3c04-4b6e-a201-73e35c5b8578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:21.796915 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143be368-3c04-4b6e-a201-73e35c5b8578 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:21.817328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1297/2593] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:21 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:21.821439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17593f20-ff5b-45c4-878f-840d54b84207 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:21.831853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17593f20-ff5b-45c4-878f-840d54b84207 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:21.837497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d735a-e970-4f55-9d0e-32837d626c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:21.838314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d735a-e970-4f55-9d0e-32837d626c3c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.838602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d735a-e970-4f55-9d0e-32837d626c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.838885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d735a-e970-4f55-9d0e-32837d626c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.839740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d735a-e970-4f55-9d0e-32837d626c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:21.841392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d735a-e970-4f55-9d0e-32837d626c3c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:21.853317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1297/2594] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:21.858358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be368-3c04-4b6e-a201-73e35c5b8578 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:21.870793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be368-3c04-4b6e-a201-73e35c5b8578 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:21.879108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c182c-f078-404b-bf15-79610e134261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:21.879827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c182c-f078-404b-bf15-79610e134261 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.880154 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c182c-f078-404b-bf15-79610e134261 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.880568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c182c-f078-404b-bf15-79610e134261 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.882217 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c182c-f078-404b-bf15-79610e134261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:21.883999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c182c-f078-404b-bf15-79610e134261 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:21.894567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1298/2595] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:21.898748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d735a-e970-4f55-9d0e-32837d626c3c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:21.909914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d735a-e970-4f55-9d0e-32837d626c3c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:21.915274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb2616-212f-46a2-98ce-78626e6559d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:21.916197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb2616-212f-46a2-98ce-78626e6559d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.916482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb2616-212f-46a2-98ce-78626e6559d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.916795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb2616-212f-46a2-98ce-78626e6559d5 admin admin] PATH_INFO: `/v3/projects/cd604d3ee31f49df990ade6a452cf047/users/3a6aa59fc9884230aa7b1c573c2595eb/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.932422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb2616-212f-46a2-98ce-78626e6559d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd604d3ee31f49df990ade6a452cf047, user_id=3a6aa59fc9884230aa7b1c573c2595eb, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:21.935223 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badb2616-212f-46a2-98ce-78626e6559d5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:21.948704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1298/2596] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:21 2022] PUT /identity/v3/projects/cd604d3ee31f49df990ade6a452cf047/users/3a6aa59fc9884230aa7b1c573c2595eb/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:21.958985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0de4-7da4-4974-8710-90a517502b45 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:21.959382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0de4-7da4-4974-8710-90a517502b45 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:21.959698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec0de4-7da4-4974-8710-90a517502b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:21.987790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-34ec0de4-7da4-4974-8710-90a517502b45 None None] MFA Rules not processed for user `3a6aa59fc9884230aa7b1c573c2595eb`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:21.989394 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-34ec0de4-7da4-4974-8710-90a517502b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:22.053581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1299/2597] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:22.058202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb2616-212f-46a2-98ce-78626e6559d5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:22.117730 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb2616-212f-46a2-98ce-78626e6559d5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:22.122318 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22efe2-0ae5-4ae3-adf6-ee4989f2a9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:22.122972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22efe2-0ae5-4ae3-adf6-ee4989f2a9a8 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:22.123255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22efe2-0ae5-4ae3-adf6-ee4989f2a9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:22.123534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22efe2-0ae5-4ae3-adf6-ee4989f2a9a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:22.124263 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22efe2-0ae5-4ae3-adf6-ee4989f2a9a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:22.126144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22efe2-0ae5-4ae3-adf6-ee4989f2a9a8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:22.152611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1299/2598] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:22 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:22.156994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0de4-7da4-4974-8710-90a517502b45 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:22.168426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec0de4-7da4-4974-8710-90a517502b45 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:22.222851 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4681-aa54-40f7-9bc1-e5f461045885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:22.223532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4681-aa54-40f7-9bc1-e5f461045885 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:22.223896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4681-aa54-40f7-9bc1-e5f461045885 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:22.224319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f4681-aa54-40f7-9bc1-e5f461045885 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:22.225238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4681-aa54-40f7-9bc1-e5f461045885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:22.227136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f4681-aa54-40f7-9bc1-e5f461045885 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:22.247877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1300/2599] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:22 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:22.252019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22efe2-0ae5-4ae3-adf6-ee4989f2a9a8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:22.263756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22efe2-0ae5-4ae3-adf6-ee4989f2a9a8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:22.268601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017990ef-3de1-49f2-b32a-2a9e21a20c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:22.269449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017990ef-3de1-49f2-b32a-2a9e21a20c99 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:22.269740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017990ef-3de1-49f2-b32a-2a9e21a20c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:22.270023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017990ef-3de1-49f2-b32a-2a9e21a20c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:22.271331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017990ef-3de1-49f2-b32a-2a9e21a20c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:22.273113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017990ef-3de1-49f2-b32a-2a9e21a20c99 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:22.283710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1300/2600] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:22.288504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4681-aa54-40f7-9bc1-e5f461045885 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:22.299146 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f4681-aa54-40f7-9bc1-e5f461045885 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:22.306882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6864630-0c02-41e1-8ce9-5f01332e3257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:22.307891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6864630-0c02-41e1-8ce9-5f01332e3257 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:22.308250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6864630-0c02-41e1-8ce9-5f01332e3257 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:22.308598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6864630-0c02-41e1-8ce9-5f01332e3257 admin admin] PATH_INFO: `/v3/projects/64f6ff17e31c443e8546c1859243d816/users/adbd5c086a8548ae8b9bf3955bc2fc89/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:22.331072 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6864630-0c02-41e1-8ce9-5f01332e3257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f6ff17e31c443e8546c1859243d816, user_id=adbd5c086a8548ae8b9bf3955bc2fc89, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:22.334165 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6864630-0c02-41e1-8ce9-5f01332e3257 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:22.348010 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1301/2601] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:22 2022] PUT /identity/v3/projects/64f6ff17e31c443e8546c1859243d816/users/adbd5c086a8548ae8b9bf3955bc2fc89/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:22.352154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017990ef-3de1-49f2-b32a-2a9e21a20c99 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:22.362396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017990ef-3de1-49f2-b32a-2a9e21a20c99 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:22.420627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8753f-ca76-40f2-bf35-6b80b16b14c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:22.421299 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8753f-ca76-40f2-bf35-6b80b16b14c5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:22.421584 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8753f-ca76-40f2-bf35-6b80b16b14c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:22.421861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8753f-ca76-40f2-bf35-6b80b16b14c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:22.422626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8753f-ca76-40f2-bf35-6b80b16b14c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:22.424210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8753f-ca76-40f2-bf35-6b80b16b14c5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:22.434590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1301/2602] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:22.438804 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6864630-0c02-41e1-8ce9-5f01332e3257 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:22.449326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6864630-0c02-41e1-8ce9-5f01332e3257 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:22.454606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f68c-8650-468a-9015-c9d1d055e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:22.455485 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f68c-8650-468a-9015-c9d1d055e328 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:22.455800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f68c-8650-468a-9015-c9d1d055e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:22.456078 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691f68c-8650-468a-9015-c9d1d055e328 admin admin] PATH_INFO: `/v3/projects/64f6ff17e31c443e8546c1859243d816/users/adbd5c086a8548ae8b9bf3955bc2fc89/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:22.458030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f68c-8650-468a-9015-c9d1d055e328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f6ff17e31c443e8546c1859243d816, user_id=adbd5c086a8548ae8b9bf3955bc2fc89, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:22.460781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691f68c-8650-468a-9015-c9d1d055e328 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:22.472443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1302/2603] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:22 2022] PUT /identity/v3/projects/64f6ff17e31c443e8546c1859243d816/users/adbd5c086a8548ae8b9bf3955bc2fc89/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:22.484245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2375-7ad7-416e-ac6c-7cc25ba64118 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:22.484536 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2375-7ad7-416e-ac6c-7cc25ba64118 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:22.484818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f2375-7ad7-416e-ac6c-7cc25ba64118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:22.513353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e49f2375-7ad7-416e-ac6c-7cc25ba64118 None None] MFA Rules not processed for user `adbd5c086a8548ae8b9bf3955bc2fc89`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:22.514601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e49f2375-7ad7-416e-ac6c-7cc25ba64118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:22.590317 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1302/2604] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:22.598186 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f68c-8650-468a-9015-c9d1d055e328 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:22.601631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f691f68c-8650-468a-9015-c9d1d055e328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:22.656437 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691f68c-8650-468a-9015-c9d1d055e328 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:22.659983 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f447665-4da9-4436-80b3-23b842a04843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:22.660618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f447665-4da9-4436-80b3-23b842a04843 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:22.660900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f447665-4da9-4436-80b3-23b842a04843 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:22.661202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f447665-4da9-4436-80b3-23b842a04843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:22.671195 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f447665-4da9-4436-80b3-23b842a04843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:22.672654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f447665-4da9-4436-80b3-23b842a04843 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:22.682101 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1303/2605] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:22.749140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f2375-7ad7-416e-ac6c-7cc25ba64118 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:22.759744 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f2375-7ad7-416e-ac6c-7cc25ba64118 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:22.763784 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062948-f360-4684-9809-ee5c78479e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:22.764434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062948-f360-4684-9809-ee5c78479e86 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:22.764716 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062948-f360-4684-9809-ee5c78479e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:22.764993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062948-f360-4684-9809-ee5c78479e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:22.819883 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90062948-f360-4684-9809-ee5c78479e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:22.821328 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90062948-f360-4684-9809-ee5c78479e86 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:22.830013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1303/2606] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:24.729560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f447665-4da9-4436-80b3-23b842a04843 service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:24.730968 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5f447665-4da9-4436-80b3-23b842a04843 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:24.784182 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f447665-4da9-4436-80b3-23b842a04843 service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:24.788354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:24.788985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:24.789264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:24.789536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:24.791239 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:24.847857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:24.849748 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:24.858986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1304/2607] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:26.270909 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062948-f360-4684-9809-ee5c78479e86 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:26.272374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-90062948-f360-4684-9809-ee5c78479e86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:26.283922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062948-f360-4684-9809-ee5c78479e86 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:26.289186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d224bfe-a8fd-45c5-a1a2-0363d5fb1115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:26.290236 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d224bfe-a8fd-45c5-a1a2-0363d5fb1115 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:26.290718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d224bfe-a8fd-45c5-a1a2-0363d5fb1115 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:26.291190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d224bfe-a8fd-45c5-a1a2-0363d5fb1115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:26.293668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7d224bfe-a8fd-45c5-a1a2-0363d5fb1115 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:26.352280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d224bfe-a8fd-45c5-a1a2-0363d5fb1115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:26.353765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d224bfe-a8fd-45c5-a1a2-0363d5fb1115 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:26.363476 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1304/2608] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:28.259281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:28.261086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:28.274312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d96cee-70a3-4c57-aaac-0d5ca92520d2 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:28.279343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:28.280401 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:28.280738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:28.281082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] PATH_INFO: `/v3/users/dd2a59a36a2e422795e977c7af5004e6` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:28.282333 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2a59a36a2e422795e977c7af5004e6)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:28.284324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:28.334953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2a59a36a2e422795e977c7af5004e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.341722 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2a59a36a2e422795e977c7af5004e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.342455 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2a59a36a2e422795e977c7af5004e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.355338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2a59a36a2e422795e977c7af5004e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.363886 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-33eea4e7-befa-4093-8f71-ffbbe4a7283c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2a59a36a2e422795e977c7af5004e6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.370586 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1305/2609] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:28 2022] DELETE /identity/v3/users/dd2a59a36a2e422795e977c7af5004e6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:28.714001 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d224bfe-a8fd-45c5-a1a2-0363d5fb1115 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:28.748563 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d224bfe-a8fd-45c5-a1a2-0363d5fb1115 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:28.816428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:28.818695 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:28.818878 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:28.819152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] PATH_INFO: `/v3/projects/11d012d792424a858b876a618c79f7af` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:28.820779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d012d792424a858b876a618c79f7af)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:28.823108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:28.879521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d012d792424a858b876a618c79f7af', 'request_id': 'req-d8fa6410-8f70-448c-a8c7-820c1927fbb4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.887113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d012d792424a858b876a618c79f7af', 'request_id': 'req-d8fa6410-8f70-448c-a8c7-820c1927fbb4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.892949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d012d792424a858b876a618c79f7af', 'request_id': 'req-d8fa6410-8f70-448c-a8c7-820c1927fbb4'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.908293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] The token cache is being invalidate because project 11d012d792424a858b876a618c79f7af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:28.908612 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.910135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d8fa6410-8f70-448c-a8c7-820c1927fbb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:28.915499 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1305/2610] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:28 2022] DELETE /identity/v3/projects/11d012d792424a858b876a618c79f7af => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:28.917375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c18145-f532-4ed4-b39e-f67abc8c688c None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:28.917736 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c18145-f532-4ed4-b39e-f67abc8c688c None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:28.918073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c18145-f532-4ed4-b39e-f67abc8c688c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:28.937607 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-19c18145-f532-4ed4-b39e-f67abc8c688c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:28.938800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-19c18145-f532-4ed4-b39e-f67abc8c688c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:29.005131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1306/2611] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:29.013501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f3be-ace1-45e0-9bbe-57d184c31c8a None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.013797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f3be-ace1-45e0-9bbe-57d184c31c8a None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.014072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f3be-ace1-45e0-9bbe-57d184c31c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.032649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-bf55f3be-ace1-45e0-9bbe-57d184c31c8a None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:29.033973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-bf55f3be-ace1-45e0-9bbe-57d184c31c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:29.042955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1306/2612] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:29.047909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c18145-f532-4ed4-b39e-f67abc8c688c None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.059233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c18145-f532-4ed4-b39e-f67abc8c688c None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.064022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62ab64-e811-4048-8e7c-b0f24000fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.064694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62ab64-e811-4048-8e7c-b0f24000fcda admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.064977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62ab64-e811-4048-8e7c-b0f24000fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.065254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62ab64-e811-4048-8e7c-b0f24000fcda admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.065996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62ab64-e811-4048-8e7c-b0f24000fcda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:29.066304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62ab64-e811-4048-8e7c-b0f24000fcda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.068058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62ab64-e811-4048-8e7c-b0f24000fcda admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.081218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1307/2613] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:56:29.086495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f3be-ace1-45e0-9bbe-57d184c31c8a None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.095407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f3be-ace1-45e0-9bbe-57d184c31c8a None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.102302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fab661-8831-4c62-8943-559ae00ac49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.102985 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fab661-8831-4c62-8943-559ae00ac49d admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.103269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fab661-8831-4c62-8943-559ae00ac49d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.103547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fab661-8831-4c62-8943-559ae00ac49d admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.104308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fab661-8831-4c62-8943-559ae00ac49d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.106289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fab661-8831-4c62-8943-559ae00ac49d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.137625 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1307/2614] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:29 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:29.138709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62ab64-e811-4048-8e7c-b0f24000fcda admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.149595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62ab64-e811-4048-8e7c-b0f24000fcda admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.207819 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc19bf2-e025-46e0-ba18-3ebe237b2a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.209300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc19bf2-e025-46e0-ba18-3ebe237b2a43 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.209589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc19bf2-e025-46e0-ba18-3ebe237b2a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.209866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc19bf2-e025-46e0-ba18-3ebe237b2a43 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.210569 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc19bf2-e025-46e0-ba18-3ebe237b2a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.212527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc19bf2-e025-46e0-ba18-3ebe237b2a43 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.232950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1308/2615] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:29 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:29.237099 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fab661-8831-4c62-8943-559ae00ac49d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.247627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fab661-8831-4c62-8943-559ae00ac49d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.252551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc894045-2552-404d-bc37-52b655fb8568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.253229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc894045-2552-404d-bc37-52b655fb8568 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.253500 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc894045-2552-404d-bc37-52b655fb8568 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.253783 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc894045-2552-404d-bc37-52b655fb8568 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.254528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc894045-2552-404d-bc37-52b655fb8568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.257020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc894045-2552-404d-bc37-52b655fb8568 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.267705 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1308/2616] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:29.272514 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc19bf2-e025-46e0-ba18-3ebe237b2a43 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.282386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc19bf2-e025-46e0-ba18-3ebe237b2a43 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.287036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a8387-849e-4d7c-bec9-3feb7561e01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.287602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a8387-849e-4d7c-bec9-3feb7561e01e admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.287884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a8387-849e-4d7c-bec9-3feb7561e01e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.288158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a8387-849e-4d7c-bec9-3feb7561e01e admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.288944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a8387-849e-4d7c-bec9-3feb7561e01e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.290430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a8387-849e-4d7c-bec9-3feb7561e01e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.300411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1309/2617] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:29.304748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc894045-2552-404d-bc37-52b655fb8568 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.314468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc894045-2552-404d-bc37-52b655fb8568 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.319806 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214669b-9b3f-45cc-abd4-d8ced15b49f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.320742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214669b-9b3f-45cc-abd4-d8ced15b49f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.321051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214669b-9b3f-45cc-abd4-d8ced15b49f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.321415 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214669b-9b3f-45cc-abd4-d8ced15b49f9 admin admin] PATH_INFO: `/v3/projects/284b770cfe2e473f80bc58bad1aee171/users/708df23318d84fdc9cd1e5c68aa4d5f1/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.336384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214669b-9b3f-45cc-abd4-d8ced15b49f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284b770cfe2e473f80bc58bad1aee171, user_id=708df23318d84fdc9cd1e5c68aa4d5f1, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.339117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0214669b-9b3f-45cc-abd4-d8ced15b49f9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.352037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1309/2618] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:29 2022] PUT /identity/v3/projects/284b770cfe2e473f80bc58bad1aee171/users/708df23318d84fdc9cd1e5c68aa4d5f1/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:29.363059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317870c0-8a55-478d-87b2-4dd50c7efdd4 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.363348 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317870c0-8a55-478d-87b2-4dd50c7efdd4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.363664 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317870c0-8a55-478d-87b2-4dd50c7efdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.390974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-317870c0-8a55-478d-87b2-4dd50c7efdd4 None None] MFA Rules not processed for user `708df23318d84fdc9cd1e5c68aa4d5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:29.392215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-317870c0-8a55-478d-87b2-4dd50c7efdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:29.453919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1310/2619] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:29.458387 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214669b-9b3f-45cc-abd4-d8ced15b49f9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.519211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214669b-9b3f-45cc-abd4-d8ced15b49f9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.524334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1d311-047b-4982-8102-9503918ea61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.525037 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1d311-047b-4982-8102-9503918ea61a admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.525319 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1d311-047b-4982-8102-9503918ea61a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.525597 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1d311-047b-4982-8102-9503918ea61a admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.526374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1d311-047b-4982-8102-9503918ea61a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.528361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1d311-047b-4982-8102-9503918ea61a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.553895 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1310/2620] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:29 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:29.557889 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317870c0-8a55-478d-87b2-4dd50c7efdd4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.569368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317870c0-8a55-478d-87b2-4dd50c7efdd4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.626261 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b149c-992e-4689-9fce-0d0bb1e00a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.627210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b149c-992e-4689-9fce-0d0bb1e00a22 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.627415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b149c-992e-4689-9fce-0d0bb1e00a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.627824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b149c-992e-4689-9fce-0d0bb1e00a22 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.628552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b149c-992e-4689-9fce-0d0bb1e00a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.630887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b149c-992e-4689-9fce-0d0bb1e00a22 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.653444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1311/2621] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:29 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:29.654668 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1d311-047b-4982-8102-9503918ea61a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.666394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1d311-047b-4982-8102-9503918ea61a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.671232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4f869-672f-49a1-8c29-ff3e180f0e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.671929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4f869-672f-49a1-8c29-ff3e180f0e53 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.672216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4f869-672f-49a1-8c29-ff3e180f0e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.672545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4f869-672f-49a1-8c29-ff3e180f0e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.673291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4f869-672f-49a1-8c29-ff3e180f0e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.674919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4f869-672f-49a1-8c29-ff3e180f0e53 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.686921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1311/2622] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:29.690906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b149c-992e-4689-9fce-0d0bb1e00a22 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.700737 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b149c-992e-4689-9fce-0d0bb1e00a22 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.705341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56c220-0f6e-44f5-ab7e-a1ede711c68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.706209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56c220-0f6e-44f5-ab7e-a1ede711c68d admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.706493 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56c220-0f6e-44f5-ab7e-a1ede711c68d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.706774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56c220-0f6e-44f5-ab7e-a1ede711c68d admin admin] PATH_INFO: `/v3/projects/a29a50ef10074de6966b8e5ea85e2bfc/users/8d3b9a822d1c4d3fbc08d19f01fd1bbc/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.721816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56c220-0f6e-44f5-ab7e-a1ede711c68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29a50ef10074de6966b8e5ea85e2bfc, user_id=8d3b9a822d1c4d3fbc08d19f01fd1bbc, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.725287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56c220-0f6e-44f5-ab7e-a1ede711c68d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.737984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1312/2623] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:29 2022] PUT /identity/v3/projects/a29a50ef10074de6966b8e5ea85e2bfc/users/8d3b9a822d1c4d3fbc08d19f01fd1bbc/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:29.742016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4f869-672f-49a1-8c29-ff3e180f0e53 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.752152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4f869-672f-49a1-8c29-ff3e180f0e53 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.805922 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77918a51-8cf6-4a53-8748-dc60f694fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.806509 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77918a51-8cf6-4a53-8748-dc60f694fbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.806791 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77918a51-8cf6-4a53-8748-dc60f694fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.807069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77918a51-8cf6-4a53-8748-dc60f694fbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.807827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77918a51-8cf6-4a53-8748-dc60f694fbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.809440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77918a51-8cf6-4a53-8748-dc60f694fbd9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.818836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1312/2624] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:29.822904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56c220-0f6e-44f5-ab7e-a1ede711c68d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.833549 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56c220-0f6e-44f5-ab7e-a1ede711c68d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:29.838175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c35df8-1132-4987-9b3f-70471ae4f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:29.839045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c35df8-1132-4987-9b3f-70471ae4f861 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.839337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c35df8-1132-4987-9b3f-70471ae4f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.839621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c35df8-1132-4987-9b3f-70471ae4f861 admin admin] PATH_INFO: `/v3/projects/a29a50ef10074de6966b8e5ea85e2bfc/users/8d3b9a822d1c4d3fbc08d19f01fd1bbc/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.841595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c35df8-1132-4987-9b3f-70471ae4f861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29a50ef10074de6966b8e5ea85e2bfc, user_id=8d3b9a822d1c4d3fbc08d19f01fd1bbc, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:29.844258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c35df8-1132-4987-9b3f-70471ae4f861 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:29.854153 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1313/2625] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:29 2022] PUT /identity/v3/projects/a29a50ef10074de6966b8e5ea85e2bfc/users/8d3b9a822d1c4d3fbc08d19f01fd1bbc/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:29.864495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff90d-0243-440d-a866-141a71961d87 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:29.864847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff90d-0243-440d-a866-141a71961d87 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:29.865104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ff90d-0243-440d-a866-141a71961d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:29.893004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-6a6ff90d-0243-440d-a866-141a71961d87 None None] MFA Rules not processed for user `8d3b9a822d1c4d3fbc08d19f01fd1bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:29.894230 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6a6ff90d-0243-440d-a866-141a71961d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:29.961265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1313/2626] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:29.971193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c35df8-1132-4987-9b3f-70471ae4f861 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:29.972894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-76c35df8-1132-4987-9b3f-70471ae4f861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:30.033301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c35df8-1132-4987-9b3f-70471ae4f861 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:30.038340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106faddc-7777-4feb-8e1f-d7408a9cc7d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:30.039189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106faddc-7777-4feb-8e1f-d7408a9cc7d2 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:30.039309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106faddc-7777-4feb-8e1f-d7408a9cc7d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:30.039582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106faddc-7777-4feb-8e1f-d7408a9cc7d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:30.049488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106faddc-7777-4feb-8e1f-d7408a9cc7d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:30.050950 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106faddc-7777-4feb-8e1f-d7408a9cc7d2 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:30.070028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1314/2627] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:29 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:30.439459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff90d-0243-440d-a866-141a71961d87 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:30.529271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ff90d-0243-440d-a866-141a71961d87 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:30.540482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:30.541428 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:30.541725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:30.542017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] PATH_INFO: `/v3/users/708df23318d84fdc9cd1e5c68aa4d5f1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:30.544484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=708df23318d84fdc9cd1e5c68aa4d5f1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:30.547342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:30.604527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '708df23318d84fdc9cd1e5c68aa4d5f1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:30.611518 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '708df23318d84fdc9cd1e5c68aa4d5f1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:30.624026 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '708df23318d84fdc9cd1e5c68aa4d5f1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:30.632463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '708df23318d84fdc9cd1e5c68aa4d5f1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:30.633112 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '708df23318d84fdc9cd1e5c68aa4d5f1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:30.639483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1314/2628] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:30 2022] DELETE /identity/v3/users/708df23318d84fdc9cd1e5c68aa4d5f1 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:30.644221 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1678b-91c0-441e-9aca-13e4f9c86246 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:30.644801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1678b-91c0-441e-9aca-13e4f9c86246 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:30.644966 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1678b-91c0-441e-9aca-13e4f9c86246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:30.665528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-b4a1678b-91c0-441e-9aca-13e4f9c86246 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:30.666781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b4a1678b-91c0-441e-9aca-13e4f9c86246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:30.734225 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1315/2629] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:30.744845 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:30.746292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:30.807686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e67f2e-ac09-403d-9858-a29fa8bb66e7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:30.812098 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c76cb0-695d-4763-b11a-a3ef573c5820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:30.812874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c76cb0-695d-4763-b11a-a3ef573c5820 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:30.813059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c76cb0-695d-4763-b11a-a3ef573c5820 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:30.813329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c76cb0-695d-4763-b11a-a3ef573c5820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:30.824629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c76cb0-695d-4763-b11a-a3ef573c5820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:30.826050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c76cb0-695d-4763-b11a-a3ef573c5820 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:30.838429 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1315/2630] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:31.123038 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1678b-91c0-441e-9aca-13e4f9c86246 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:31.124726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b4a1678b-91c0-441e-9aca-13e4f9c86246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:31.140052 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1678b-91c0-441e-9aca-13e4f9c86246 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:31.145979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:31.148006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:31.148292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:31.148568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] PATH_INFO: `/v3/projects/284b770cfe2e473f80bc58bad1aee171` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:31.149807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=284b770cfe2e473f80bc58bad1aee171)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:31.151744 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:31.202082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284b770cfe2e473f80bc58bad1aee171', 'request_id': 'req-ce8f2250-cdba-4c92-8810-ec47fc50d226'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.210384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284b770cfe2e473f80bc58bad1aee171', 'request_id': 'req-ce8f2250-cdba-4c92-8810-ec47fc50d226'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.217594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284b770cfe2e473f80bc58bad1aee171', 'request_id': 'req-ce8f2250-cdba-4c92-8810-ec47fc50d226'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.234145 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] The token cache is being invalidate because project 284b770cfe2e473f80bc58bad1aee171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:31.234519 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.235555 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.237392 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1316/2631] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:31 2022] DELETE /identity/v3/projects/284b770cfe2e473f80bc58bad1aee171 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:31.241690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c76cb0-695d-4763-b11a-a3ef573c5820 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:31.252719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c76cb0-695d-4763-b11a-a3ef573c5820 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:31.312413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:31.313322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:31.313613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:31.313892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] PATH_INFO: `/v3/users/8d3b9a822d1c4d3fbc08d19f01fd1bbc` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:31.315086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3b9a822d1c4d3fbc08d19f01fd1bbc)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:31.317788 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:31.360034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3b9a822d1c4d3fbc08d19f01fd1bbc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.367487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3b9a822d1c4d3fbc08d19f01fd1bbc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.378439 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3b9a822d1c4d3fbc08d19f01fd1bbc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.386341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3b9a822d1c4d3fbc08d19f01fd1bbc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.387116 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3b9a822d1c4d3fbc08d19f01fd1bbc'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:31.392787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1316/2632] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:31 2022] DELETE /identity/v3/users/8d3b9a822d1c4d3fbc08d19f01fd1bbc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:31.889532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:31.890944 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:31.904488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2250-cdba-4c92-8810-ec47fc50d226 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:31.922819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:31.924800 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:31.971482 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:31.972416 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:31.972709 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:31.972985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] PATH_INFO: `/v3/users/3a6aa59fc9884230aa7b1c573c2595eb` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:31.974298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a6aa59fc9884230aa7b1c573c2595eb)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:31.976260 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:31.991886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f4682-5140-4508-9eba-e2e8d78d63c1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:31.996479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:31.997341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:31.997627 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:31.997910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] PATH_INFO: `/v3/projects/a29a50ef10074de6966b8e5ea85e2bfc` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:31.999106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29a50ef10074de6966b8e5ea85e2bfc)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.001303 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.021755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a6aa59fc9884230aa7b1c573c2595eb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.028484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a6aa59fc9884230aa7b1c573c2595eb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.029163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a6aa59fc9884230aa7b1c573c2595eb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.042156 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a6aa59fc9884230aa7b1c573c2595eb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.048854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29a50ef10074de6966b8e5ea85e2bfc', 'request_id': 'req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.050012 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bde67ac1-f805-4592-a34b-d22d400741a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a6aa59fc9884230aa7b1c573c2595eb'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.055473 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29a50ef10074de6966b8e5ea85e2bfc', 'request_id': 'req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.055925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1317/2633] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:31 2022] DELETE /identity/v3/users/3a6aa59fc9884230aa7b1c573c2595eb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:32.060302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9497e2c-5fed-4412-902c-04037c036969 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.060593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9497e2c-5fed-4412-902c-04037c036969 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.060875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9497e2c-5fed-4412-902c-04037c036969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.061012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29a50ef10074de6966b8e5ea85e2bfc', 'request_id': 'req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.073590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] The token cache is being invalidate because project a29a50ef10074de6966b8e5ea85e2bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:32.073882 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.074519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6410bbe0-1d9b-422a-ad23-f02f8e37fb11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.076074 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1317/2634] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:31 2022] DELETE /identity/v3/projects/a29a50ef10074de6966b8e5ea85e2bfc => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:32.080740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e9497e2c-5fed-4412-902c-04037c036969 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:32.080740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e9497e2c-5fed-4412-902c-04037c036969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:32.082056 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc0305-939f-4b48-9b40-38ad52c54fb5 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.082343 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc0305-939f-4b48-9b40-38ad52c54fb5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.083233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc0305-939f-4b48-9b40-38ad52c54fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.100701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-a8cc0305-939f-4b48-9b40-38ad52c54fb5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:32.101880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a8cc0305-939f-4b48-9b40-38ad52c54fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:32.136382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1318/2635] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:32.146707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9497e2c-5fed-4412-902c-04037c036969 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.148148 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e9497e2c-5fed-4412-902c-04037c036969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:32.163910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1318/2636] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:32.171386 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55ec6-d3eb-4758-bf0e-59ec066f518c None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.171761 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55ec6-d3eb-4758-bf0e-59ec066f518c None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.172052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee55ec6-d3eb-4758-bf0e-59ec066f518c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.189610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-aee55ec6-d3eb-4758-bf0e-59ec066f518c None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:32.190816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-aee55ec6-d3eb-4758-bf0e-59ec066f518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:32.199375 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1319/2637] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:32.203436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55ec6-d3eb-4758-bf0e-59ec066f518c None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.203621 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9497e2c-5fed-4412-902c-04037c036969 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.207241 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884805fb-9f98-4bd6-8ad2-e6c30918c9d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.208548 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884805fb-9f98-4bd6-8ad2-e6c30918c9d7 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.208837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884805fb-9f98-4bd6-8ad2-e6c30918c9d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.209110 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884805fb-9f98-4bd6-8ad2-e6c30918c9d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.217447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee55ec6-d3eb-4758-bf0e-59ec066f518c None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.218251 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884805fb-9f98-4bd6-8ad2-e6c30918c9d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.219701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884805fb-9f98-4bd6-8ad2-e6c30918c9d7 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.222065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f19c46-37d7-4dea-b957-3e7e6137fb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.222719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f19c46-37d7-4dea-b957-3e7e6137fb61 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.223002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f19c46-37d7-4dea-b957-3e7e6137fb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.223342 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f19c46-37d7-4dea-b957-3e7e6137fb61 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.224108 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f19c46-37d7-4dea-b957-3e7e6137fb61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:32.224418 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f19c46-37d7-4dea-b957-3e7e6137fb61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.226007 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f19c46-37d7-4dea-b957-3e7e6137fb61 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.229591 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1319/2638] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:32.237504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1320/2639] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:56:32.242001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884805fb-9f98-4bd6-8ad2-e6c30918c9d7 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.251488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884805fb-9f98-4bd6-8ad2-e6c30918c9d7 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.256996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486829f4-cf2a-4989-8000-d89095ee2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.257652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486829f4-cf2a-4989-8000-d89095ee2c9c admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.257942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486829f4-cf2a-4989-8000-d89095ee2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.258224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486829f4-cf2a-4989-8000-d89095ee2c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.258942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486829f4-cf2a-4989-8000-d89095ee2c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.261171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486829f4-cf2a-4989-8000-d89095ee2c9c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.287958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1320/2640] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:32 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:32.292339 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f19c46-37d7-4dea-b957-3e7e6137fb61 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.303975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f19c46-37d7-4dea-b957-3e7e6137fb61 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.376040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27514ab-5ae7-48c4-b13c-2a57043a8612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.376815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27514ab-5ae7-48c4-b13c-2a57043a8612 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.377116 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27514ab-5ae7-48c4-b13c-2a57043a8612 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.377406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27514ab-5ae7-48c4-b13c-2a57043a8612 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.378142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27514ab-5ae7-48c4-b13c-2a57043a8612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.380677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27514ab-5ae7-48c4-b13c-2a57043a8612 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.402297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1321/2641] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:32 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:32.406707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486829f4-cf2a-4989-8000-d89095ee2c9c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.417184 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486829f4-cf2a-4989-8000-d89095ee2c9c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.422230 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398689d-2802-42ce-b6e8-086382bef337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.423018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398689d-2802-42ce-b6e8-086382bef337 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.423406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398689d-2802-42ce-b6e8-086382bef337 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.423822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398689d-2802-42ce-b6e8-086382bef337 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.424659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398689d-2802-42ce-b6e8-086382bef337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.426388 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398689d-2802-42ce-b6e8-086382bef337 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.437368 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1321/2642] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:32.441133 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27514ab-5ae7-48c4-b13c-2a57043a8612 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.451603 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27514ab-5ae7-48c4-b13c-2a57043a8612 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.456381 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc830f2-131f-467d-8edb-e694eb8d77b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.457046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc830f2-131f-467d-8edb-e694eb8d77b4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.457332 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc830f2-131f-467d-8edb-e694eb8d77b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.458359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc830f2-131f-467d-8edb-e694eb8d77b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.459133 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc830f2-131f-467d-8edb-e694eb8d77b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.460768 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc830f2-131f-467d-8edb-e694eb8d77b4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.472832 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1322/2643] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:32.476978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398689d-2802-42ce-b6e8-086382bef337 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.486693 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398689d-2802-42ce-b6e8-086382bef337 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.491451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbad6d-18d9-4196-9ff8-cc8de94879ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.492422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbad6d-18d9-4196-9ff8-cc8de94879ea admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.492649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbad6d-18d9-4196-9ff8-cc8de94879ea admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.492927 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbad6d-18d9-4196-9ff8-cc8de94879ea admin admin] PATH_INFO: `/v3/projects/888de90fc17a422ba979e468cd5ae79b/users/30b5123cd14349f7bb90f1d7a039aba3/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.509108 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbad6d-18d9-4196-9ff8-cc8de94879ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=888de90fc17a422ba979e468cd5ae79b, user_id=30b5123cd14349f7bb90f1d7a039aba3, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.512130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbad6d-18d9-4196-9ff8-cc8de94879ea admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.527197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1322/2644] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:32 2022] PUT /identity/v3/projects/888de90fc17a422ba979e468cd5ae79b/users/30b5123cd14349f7bb90f1d7a039aba3/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:32.538802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafea41-7916-45d5-9a15-fbe1e9291069 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.539126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafea41-7916-45d5-9a15-fbe1e9291069 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.539456 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafea41-7916-45d5-9a15-fbe1e9291069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.575049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-fcafea41-7916-45d5-9a15-fbe1e9291069 None None] MFA Rules not processed for user `30b5123cd14349f7bb90f1d7a039aba3`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:32.576452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-fcafea41-7916-45d5-9a15-fbe1e9291069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:32.577996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbad6d-18d9-4196-9ff8-cc8de94879ea admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.580652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-02cbad6d-18d9-4196-9ff8-cc8de94879ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:32.651964 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbad6d-18d9-4196-9ff8-cc8de94879ea admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.656967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.657911 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.658265 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.658610 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] PATH_INFO: `/v3/projects/cd604d3ee31f49df990ade6a452cf047` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.660058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd604d3ee31f49df990ade6a452cf047)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.663784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.669879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1323/2645] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:32.669879 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafea41-7916-45d5-9a15-fbe1e9291069 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.711914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd604d3ee31f49df990ade6a452cf047', 'request_id': 'req-79658281-07d3-44e8-867c-b0310c4709ef'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.719127 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd604d3ee31f49df990ade6a452cf047', 'request_id': 'req-79658281-07d3-44e8-867c-b0310c4709ef'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.723764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafea41-7916-45d5-9a15-fbe1e9291069 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.726988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd604d3ee31f49df990ade6a452cf047', 'request_id': 'req-79658281-07d3-44e8-867c-b0310c4709ef'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.736955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] The token cache is being invalidate because project cd604d3ee31f49df990ade6a452cf047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:32.737248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.737904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.739678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1323/2646] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:32 2022] DELETE /identity/v3/projects/cd604d3ee31f49df990ade6a452cf047 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:32.743420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.744697 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:32.772538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324ab64-03ff-4d77-a48a-172358f1831c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.773329 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324ab64-03ff-4d77-a48a-172358f1831c service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.773614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324ab64-03ff-4d77-a48a-172358f1831c service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.773892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324ab64-03ff-4d77-a48a-172358f1831c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.775697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e324ab64-03ff-4d77-a48a-172358f1831c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:32.809510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79658281-07d3-44e8-867c-b0310c4709ef admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.814200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47e3d6-0b05-4639-8b64-298867402855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.814857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e3d6-0b05-4639-8b64-298867402855 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.815140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e3d6-0b05-4639-8b64-298867402855 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.815417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e3d6-0b05-4639-8b64-298867402855 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.816152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47e3d6-0b05-4639-8b64-298867402855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.818589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47e3d6-0b05-4639-8b64-298867402855 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.837155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324ab64-03ff-4d77-a48a-172358f1831c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.838833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324ab64-03ff-4d77-a48a-172358f1831c service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.844382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1324/2647] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:32 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:32.845374 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47e3d6-0b05-4639-8b64-298867402855 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.846904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ff47e3d6-0b05-4639-8b64-298867402855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:32.849087 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1324/2648] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:32.856344 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324ab64-03ff-4d77-a48a-172358f1831c service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.869354 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324ab64-03ff-4d77-a48a-172358f1831c service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.915403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47e3d6-0b05-4639-8b64-298867402855 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.920254 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.921189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.921544 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.921924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] PATH_INFO: `/v3/users/adbd5c086a8548ae8b9bf3955bc2fc89` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.923218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbd5c086a8548ae8b9bf3955bc2fc89)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.925250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.928759 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a640ef-2e13-4330-9fb7-eb985494373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.929448 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a640ef-2e13-4330-9fb7-eb985494373a admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.929812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a640ef-2e13-4330-9fb7-eb985494373a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.930312 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a640ef-2e13-4330-9fb7-eb985494373a admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.930927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a640ef-2e13-4330-9fb7-eb985494373a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.933181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a640ef-2e13-4330-9fb7-eb985494373a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.956306 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1325/2649] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:32 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:32.961389 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a640ef-2e13-4330-9fb7-eb985494373a admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.971505 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a640ef-2e13-4330-9fb7-eb985494373a admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:32.976255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbd5c086a8548ae8b9bf3955bc2fc89'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.976407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9a6e0-9615-46f3-8d22-2b6779262f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:32.977030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9a6e0-9615-46f3-8d22-2b6779262f01 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:32.977287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9a6e0-9615-46f3-8d22-2b6779262f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:32.977565 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9a6e0-9615-46f3-8d22-2b6779262f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:32.978302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9a6e0-9615-46f3-8d22-2b6779262f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:32.979923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9a6e0-9615-46f3-8d22-2b6779262f01 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:32.983973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbd5c086a8548ae8b9bf3955bc2fc89'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.984864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbd5c086a8548ae8b9bf3955bc2fc89'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:32.990815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1326/2650] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:32.995029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9a6e0-9615-46f3-8d22-2b6779262f01 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:32.998002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbd5c086a8548ae8b9bf3955bc2fc89'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.006073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9a6e0-9615-46f3-8d22-2b6779262f01 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:33.007028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbd5c086a8548ae8b9bf3955bc2fc89'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.011449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20d947-4638-451c-bda2-56c6988ea3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:33.012385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20d947-4638-451c-bda2-56c6988ea3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.012652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20d947-4638-451c-bda2-56c6988ea3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.012930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20d947-4638-451c-bda2-56c6988ea3fe admin admin] PATH_INFO: `/v3/projects/130d774b7c364c3b81fa879a154a1ec3/users/dbae9c26039e4b128907f0e524e15727/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.017035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1325/2651] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:32 2022] DELETE /identity/v3/users/adbd5c086a8548ae8b9bf3955bc2fc89 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:33.028897 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20d947-4638-451c-bda2-56c6988ea3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=130d774b7c364c3b81fa879a154a1ec3, user_id=dbae9c26039e4b128907f0e524e15727, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:33.031936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20d947-4638-451c-bda2-56c6988ea3fe admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:33.052059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1327/2652] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:32 2022] PUT /identity/v3/projects/130d774b7c364c3b81fa879a154a1ec3/users/dbae9c26039e4b128907f0e524e15727/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:33.056321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:33.058322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:33.133843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bc816-beda-4e87-a72e-9606914e929d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:33.201280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e114930-4a9f-4918-b9bc-0ab123997239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:33.202035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114930-4a9f-4918-b9bc-0ab123997239 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.202324 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114930-4a9f-4918-b9bc-0ab123997239 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.202606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e114930-4a9f-4918-b9bc-0ab123997239 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.203386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e114930-4a9f-4918-b9bc-0ab123997239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:33.205073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e114930-4a9f-4918-b9bc-0ab123997239 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:33.215081 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1326/2653] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:33.219343 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20d947-4638-451c-bda2-56c6988ea3fe admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:33.230737 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20d947-4638-451c-bda2-56c6988ea3fe admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:33.235454 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097143f7-f6f5-485c-a2eb-c82657f0f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:33.236374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097143f7-f6f5-485c-a2eb-c82657f0f460 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.236662 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097143f7-f6f5-485c-a2eb-c82657f0f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.236951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097143f7-f6f5-485c-a2eb-c82657f0f460 admin admin] PATH_INFO: `/v3/projects/130d774b7c364c3b81fa879a154a1ec3/users/dbae9c26039e4b128907f0e524e15727/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.239718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097143f7-f6f5-485c-a2eb-c82657f0f460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130d774b7c364c3b81fa879a154a1ec3, user_id=dbae9c26039e4b128907f0e524e15727, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:33.242364 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097143f7-f6f5-485c-a2eb-c82657f0f460 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:33.253171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1328/2654] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:33 2022] PUT /identity/v3/projects/130d774b7c364c3b81fa879a154a1ec3/users/dbae9c26039e4b128907f0e524e15727/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:33.263847 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eadf79-c8a9-4bf1-b52c-d07b2ddde839 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.264141 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eadf79-c8a9-4bf1-b52c-d07b2ddde839 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.264419 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eadf79-c8a9-4bf1-b52c-d07b2ddde839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.292623 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d9eadf79-c8a9-4bf1-b52c-d07b2ddde839 None None] MFA Rules not processed for user `dbae9c26039e4b128907f0e524e15727`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:33.293850 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d9eadf79-c8a9-4bf1-b52c-d07b2ddde839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:33.362126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1327/2655] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:33.373117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097143f7-f6f5-485c-a2eb-c82657f0f460 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:33.374813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-097143f7-f6f5-485c-a2eb-c82657f0f460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:33.435249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097143f7-f6f5-485c-a2eb-c82657f0f460 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:33.439210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250430bf-7ced-4340-ac1e-920936633362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:33.439917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250430bf-7ced-4340-ac1e-920936633362 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.440200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250430bf-7ced-4340-ac1e-920936633362 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.440479 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250430bf-7ced-4340-ac1e-920936633362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.451314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250430bf-7ced-4340-ac1e-920936633362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:33.452831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250430bf-7ced-4340-ac1e-920936633362 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:33.463156 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1329/2656] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:33.469445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eadf79-c8a9-4bf1-b52c-d07b2ddde839 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:33.470900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d9eadf79-c8a9-4bf1-b52c-d07b2ddde839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:33.556322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eadf79-c8a9-4bf1-b52c-d07b2ddde839 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:33.562442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:33.563473 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.563877 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.564243 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] PATH_INFO: `/v3/projects/64f6ff17e31c443e8546c1859243d816` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.565545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f6ff17e31c443e8546c1859243d816)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:33.568389 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:33.622284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f6ff17e31c443e8546c1859243d816', 'request_id': 'req-9cf47c6f-c304-4159-b520-c89cdf81cf90'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.631249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f6ff17e31c443e8546c1859243d816', 'request_id': 'req-9cf47c6f-c304-4159-b520-c89cdf81cf90'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.643692 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f6ff17e31c443e8546c1859243d816', 'request_id': 'req-9cf47c6f-c304-4159-b520-c89cdf81cf90'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.658100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] The token cache is being invalidate because project 64f6ff17e31c443e8546c1859243d816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:33.658402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.659097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9cf47c6f-c304-4159-b520-c89cdf81cf90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.659283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250430bf-7ced-4340-ac1e-920936633362 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:33.661531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1328/2657] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:33 2022] DELETE /identity/v3/projects/64f6ff17e31c443e8546c1859243d816 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:33.666879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0afeee-1bb5-4145-99ee-21d5d9a6b444 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.667170 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0afeee-1bb5-4145-99ee-21d5d9a6b444 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.667479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0afeee-1bb5-4145-99ee-21d5d9a6b444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.672147 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250430bf-7ced-4340-ac1e-920936633362 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:33.686358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-1c0afeee-1bb5-4145-99ee-21d5d9a6b444 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:33.687561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-1c0afeee-1bb5-4145-99ee-21d5d9a6b444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:33.733327 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:33.734208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.734490 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.734767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] PATH_INFO: `/v3/users/30b5123cd14349f7bb90f1d7a039aba3` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.736167 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b5123cd14349f7bb90f1d7a039aba3)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:33.738416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:33.754923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1329/2658] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:33.762844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711af2-28e3-4f3c-bf34-f3c873c78cc5 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.763139 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711af2-28e3-4f3c-bf34-f3c873c78cc5 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.763423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd711af2-28e3-4f3c-bf34-f3c873c78cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.783017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-bd711af2-28e3-4f3c-bf34-f3c873c78cc5 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:33.784269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-bd711af2-28e3-4f3c-bf34-f3c873c78cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:33.790623 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b5123cd14349f7bb90f1d7a039aba3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.793216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1330/2659] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:33.797269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd711af2-28e3-4f3c-bf34-f3c873c78cc5 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:33.798113 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b5123cd14349f7bb90f1d7a039aba3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.806772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd711af2-28e3-4f3c-bf34-f3c873c78cc5 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:33.813293 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b5123cd14349f7bb90f1d7a039aba3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.813660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:33.814320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.814602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.814879 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.815640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:33.815955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:33.817835 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:33.822172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b5123cd14349f7bb90f1d7a039aba3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.822948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d9ae1444-85f4-489e-8894-6121d451440d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b5123cd14349f7bb90f1d7a039aba3'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:33.830248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1331/2660] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:56:33.834382 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1330/2661] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:33 2022] DELETE /identity/v3/users/30b5123cd14349f7bb90f1d7a039aba3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:33.835177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:33.837347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:33.838540 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c983c-c930-494a-87cd-0d4569198e32 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.838867 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c983c-c930-494a-87cd-0d4569198e32 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.839449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c983c-c930-494a-87cd-0d4569198e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.851463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc77cf-e9ea-4846-8528-5f2b9b570463 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:33.857082 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3a2c983c-c930-494a-87cd-0d4569198e32 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:33.858313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3a2c983c-c930-494a-87cd-0d4569198e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:33.908783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d52c57-f2e5-478e-b89d-4bf3f8c38c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:33.909450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d52c57-f2e5-478e-b89d-4bf3f8c38c00 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:33.909735 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d52c57-f2e5-478e-b89d-4bf3f8c38c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:33.910044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d52c57-f2e5-478e-b89d-4bf3f8c38c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:33.911420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d52c57-f2e5-478e-b89d-4bf3f8c38c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:33.913407 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d52c57-f2e5-478e-b89d-4bf3f8c38c00 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:33.936031 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1331/2662] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:33.952534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1332/2663] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:33 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:33.954362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c983c-c930-494a-87cd-0d4569198e32 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:33.962772 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d52c57-f2e5-478e-b89d-4bf3f8c38c00 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:33.964568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e6d52c57-f2e5-478e-b89d-4bf3f8c38c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:33.964689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c983c-c930-494a-87cd-0d4569198e32 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.039490 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d52c57-f2e5-478e-b89d-4bf3f8c38c00 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.043137 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd25e99-2d87-41d8-b223-666ec63a6a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.043975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd25e99-2d87-41d8-b223-666ec63a6a56 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.044696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd25e99-2d87-41d8-b223-666ec63a6a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.045178 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd25e99-2d87-41d8-b223-666ec63a6a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.047977 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31549e03-c351-43d9-bc75-13bea3ff9317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.049002 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31549e03-c351-43d9-bc75-13bea3ff9317 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.049444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31549e03-c351-43d9-bc75-13bea3ff9317 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.049885 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31549e03-c351-43d9-bc75-13bea3ff9317 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.050855 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31549e03-c351-43d9-bc75-13bea3ff9317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.054076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31549e03-c351-43d9-bc75-13bea3ff9317 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.059201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd25e99-2d87-41d8-b223-666ec63a6a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.061002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd25e99-2d87-41d8-b223-666ec63a6a56 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.072799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1333/2664] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:56:34.082993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1332/2665] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:33 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:34.087525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd25e99-2d87-41d8-b223-666ec63a6a56 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.098516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd25e99-2d87-41d8-b223-666ec63a6a56 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.103626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd650c-b437-4608-a7e4-cf421d750d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.104919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd650c-b437-4608-a7e4-cf421d750d00 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.105276 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd650c-b437-4608-a7e4-cf421d750d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.105625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd650c-b437-4608-a7e4-cf421d750d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.106443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd650c-b437-4608-a7e4-cf421d750d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.108321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd650c-b437-4608-a7e4-cf421d750d00 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.123716 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1334/2666] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:34.124946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31549e03-c351-43d9-bc75-13bea3ff9317 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.138999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31549e03-c351-43d9-bc75-13bea3ff9317 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.144139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac55bc0-7cd0-4b62-b287-35bff0c48185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.144809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac55bc0-7cd0-4b62-b287-35bff0c48185 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.145697 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac55bc0-7cd0-4b62-b287-35bff0c48185 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.145975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac55bc0-7cd0-4b62-b287-35bff0c48185 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.146856 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac55bc0-7cd0-4b62-b287-35bff0c48185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.148555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac55bc0-7cd0-4b62-b287-35bff0c48185 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.158810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1333/2667] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:34.163234 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd650c-b437-4608-a7e4-cf421d750d00 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.173167 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd650c-b437-4608-a7e4-cf421d750d00 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.179491 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40d6b0-c0bd-49c2-8da7-78bb0e4822fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.180609 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40d6b0-c0bd-49c2-8da7-78bb0e4822fb admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.180894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40d6b0-c0bd-49c2-8da7-78bb0e4822fb admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.181175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc40d6b0-c0bd-49c2-8da7-78bb0e4822fb admin admin] PATH_INFO: `/v3/projects/bcdb84837f2f448cbbcfc66d6f2c455f/users/7d0f4753571748109d4dfd64d94de9e1/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.198484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40d6b0-c0bd-49c2-8da7-78bb0e4822fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdb84837f2f448cbbcfc66d6f2c455f, user_id=7d0f4753571748109d4dfd64d94de9e1, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.201149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc40d6b0-c0bd-49c2-8da7-78bb0e4822fb admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.213863 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1335/2668] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:34 2022] PUT /identity/v3/projects/bcdb84837f2f448cbbcfc66d6f2c455f/users/7d0f4753571748109d4dfd64d94de9e1/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:34.225467 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a031-921b-4bfd-845a-3c8c5ab1cd30 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.225757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a031-921b-4bfd-845a-3c8c5ab1cd30 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.226039 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a031-921b-4bfd-845a-3c8c5ab1cd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.252999 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-38c7a031-921b-4bfd-845a-3c8c5ab1cd30 None None] MFA Rules not processed for user `7d0f4753571748109d4dfd64d94de9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:34.254193 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-38c7a031-921b-4bfd-845a-3c8c5ab1cd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:34.318474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1334/2669] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:34.322882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40d6b0-c0bd-49c2-8da7-78bb0e4822fb admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.388838 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc40d6b0-c0bd-49c2-8da7-78bb0e4822fb admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.394572 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76d28-752d-4ac5-8070-7157a0c623a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.395814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76d28-752d-4ac5-8070-7157a0c623a0 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.396098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76d28-752d-4ac5-8070-7157a0c623a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.396370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be76d28-752d-4ac5-8070-7157a0c623a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.397466 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be76d28-752d-4ac5-8070-7157a0c623a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.399376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be76d28-752d-4ac5-8070-7157a0c623a0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.433474 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1336/2670] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:34 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:34.437230 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a031-921b-4bfd-845a-3c8c5ab1cd30 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.448432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a031-921b-4bfd-845a-3c8c5ab1cd30 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.504044 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76d28-752d-4ac5-8070-7157a0c623a0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.506581 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6be76d28-752d-4ac5-8070-7157a0c623a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:34.539253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bffb1-7bda-40f7-a9d5-6863c58e8882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.540050 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bffb1-7bda-40f7-a9d5-6863c58e8882 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.540411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bffb1-7bda-40f7-a9d5-6863c58e8882 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.541183 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bffb1-7bda-40f7-a9d5-6863c58e8882 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.545534 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bffb1-7bda-40f7-a9d5-6863c58e8882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.547684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bffb1-7bda-40f7-a9d5-6863c58e8882 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.571880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1335/2671] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:34 2022] POST /identity/v3/users => generated 298 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:34.581334 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bffb1-7bda-40f7-a9d5-6863c58e8882 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.601875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bffb1-7bda-40f7-a9d5-6863c58e8882 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.603854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be76d28-752d-4ac5-8070-7157a0c623a0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.606771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa7b60-a1c4-4ad6-ab9d-df3ac932e426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.607446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa7b60-a1c4-4ad6-ab9d-df3ac932e426 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.607774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa7b60-a1c4-4ad6-ab9d-df3ac932e426 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.608054 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa7b60-a1c4-4ad6-ab9d-df3ac932e426 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.608801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa7b60-a1c4-4ad6-ab9d-df3ac932e426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.609479 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.610418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.610560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa7b60-a1c4-4ad6-ab9d-df3ac932e426 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.610839 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.611189 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] PATH_INFO: `/v3/projects/888de90fc17a422ba979e468cd5ae79b` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.612679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=888de90fc17a422ba979e468cd5ae79b)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.615126 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.621545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1336/2672] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:34.628538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa7b60-a1c4-4ad6-ab9d-df3ac932e426 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.641245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa7b60-a1c4-4ad6-ab9d-df3ac932e426 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.647075 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f944e-788e-41d5-ad68-81a54487d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.648083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f944e-788e-41d5-ad68-81a54487d28e admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.648392 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f944e-788e-41d5-ad68-81a54487d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.648669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f944e-788e-41d5-ad68-81a54487d28e admin admin] PATH_INFO: `/v3/projects/3e40ecb4666046ae8a1c2867c7d3fcbe/users/608745c832574f1683be4c12b2643aed/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.669426 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f944e-788e-41d5-ad68-81a54487d28e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e40ecb4666046ae8a1c2867c7d3fcbe, user_id=608745c832574f1683be4c12b2643aed, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.673126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f944e-788e-41d5-ad68-81a54487d28e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.697875 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '888de90fc17a422ba979e468cd5ae79b', 'request_id': 'req-24e600a0-7519-447b-93b0-6fa08319f03b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.708755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '888de90fc17a422ba979e468cd5ae79b', 'request_id': 'req-24e600a0-7519-447b-93b0-6fa08319f03b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.718778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '888de90fc17a422ba979e468cd5ae79b', 'request_id': 'req-24e600a0-7519-447b-93b0-6fa08319f03b'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.719960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1337/2673] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:34 2022] PUT /identity/v3/projects/3e40ecb4666046ae8a1c2867c7d3fcbe/users/608745c832574f1683be4c12b2643aed/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:34.720974 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f944e-788e-41d5-ad68-81a54487d28e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.730742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] The token cache is being invalidate because project 888de90fc17a422ba979e468cd5ae79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:34.731035 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.731862 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.736405 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1337/2674] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:34 2022] DELETE /identity/v3/projects/888de90fc17a422ba979e468cd5ae79b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:34.737422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.738894 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:34.795105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f944e-788e-41d5-ad68-81a54487d28e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.804494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc238cd-c69e-435b-aa45-3ddd7a208e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.806049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc238cd-c69e-435b-aa45-3ddd7a208e32 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.806049 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc238cd-c69e-435b-aa45-3ddd7a208e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.806341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc238cd-c69e-435b-aa45-3ddd7a208e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.807755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc238cd-c69e-435b-aa45-3ddd7a208e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.810010 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc238cd-c69e-435b-aa45-3ddd7a208e32 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.817598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e600a0-7519-447b-93b0-6fa08319f03b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.823867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.824797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.825446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.825825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] PATH_INFO: `/v3/users/dbae9c26039e4b128907f0e524e15727` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.829094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1338/2675] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:34.829235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbae9c26039e4b128907f0e524e15727)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.829512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.830680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc238cd-c69e-435b-aa45-3ddd7a208e32 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:34.833335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6fc238cd-c69e-435b-aa45-3ddd7a208e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:34.849873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc238cd-c69e-435b-aa45-3ddd7a208e32 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:34.856745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1c155-7f99-476a-ad3d-b927be045ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:34.857649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c155-7f99-476a-ad3d-b927be045ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.857934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c155-7f99-476a-ad3d-b927be045ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.858211 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c155-7f99-476a-ad3d-b927be045ce0 admin admin] PATH_INFO: `/v3/projects/3e40ecb4666046ae8a1c2867c7d3fcbe/users/608745c832574f1683be4c12b2643aed/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.861851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1c155-7f99-476a-ad3d-b927be045ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e40ecb4666046ae8a1c2867c7d3fcbe, user_id=608745c832574f1683be4c12b2643aed, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:34.865569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1c155-7f99-476a-ad3d-b927be045ce0 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:34.886611 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1339/2676] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:34 2022] PUT /identity/v3/projects/3e40ecb4666046ae8a1c2867c7d3fcbe/users/608745c832574f1683be4c12b2643aed/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:34.888504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384420-b19a-4f92-bfdd-fb83b2294458 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:34.888794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384420-b19a-4f92-bfdd-fb83b2294458 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:34.889068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73384420-b19a-4f92-bfdd-fb83b2294458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:34.897768 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbae9c26039e4b128907f0e524e15727'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.906636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbae9c26039e4b128907f0e524e15727'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.907634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbae9c26039e4b128907f0e524e15727'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.920501 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-73384420-b19a-4f92-bfdd-fb83b2294458 None None] MFA Rules not processed for user `608745c832574f1683be4c12b2643aed`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:34.921795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-73384420-b19a-4f92-bfdd-fb83b2294458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:34.928318 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbae9c26039e4b128907f0e524e15727'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.938445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbae9c26039e4b128907f0e524e15727'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:34.947317 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1338/2677] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:34 2022] DELETE /identity/v3/users/dbae9c26039e4b128907f0e524e15727 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:35.029284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1340/2678] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:35.039597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:35.041701 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:35.125140 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a4147-3f03-40c3-ac66-b947d80c18b7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:35.133249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3320b0-152c-48c9-9f63-820cf9fa352c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:35.134054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3320b0-152c-48c9-9f63-820cf9fa352c service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:35.134341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3320b0-152c-48c9-9f63-820cf9fa352c service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:35.134619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3320b0-152c-48c9-9f63-820cf9fa352c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:35.206582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3320b0-152c-48c9-9f63-820cf9fa352c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:35.209305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3320b0-152c-48c9-9f63-820cf9fa352c service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:35.220370 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1339/2679] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:35.317812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73384420-b19a-4f92-bfdd-fb83b2294458 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:35.373982 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73384420-b19a-4f92-bfdd-fb83b2294458 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:35.377493 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d74205-5d5a-4128-be90-3726f1eb8f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:35.378175 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d74205-5d5a-4128-be90-3726f1eb8f69 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:35.378457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d74205-5d5a-4128-be90-3726f1eb8f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:35.378736 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d74205-5d5a-4128-be90-3726f1eb8f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:35.380861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-94d74205-5d5a-4128-be90-3726f1eb8f69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:35.439798 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d74205-5d5a-4128-be90-3726f1eb8f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:35.441414 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d74205-5d5a-4128-be90-3726f1eb8f69 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:35.450859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1341/2680] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:35.723818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3320b0-152c-48c9-9f63-820cf9fa352c service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:35.725603 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-eb3320b0-152c-48c9-9f63-820cf9fa352c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:35.827528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3320b0-152c-48c9-9f63-820cf9fa352c service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:35.833447 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:35.834630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:35.834988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:35.835308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] PATH_INFO: `/v3/projects/130d774b7c364c3b81fa879a154a1ec3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:35.836617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=130d774b7c364c3b81fa879a154a1ec3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:35.839083 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:35.895932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130d774b7c364c3b81fa879a154a1ec3', 'request_id': 'req-df5dfb2e-662e-44f5-803a-d3d031fdad07'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:35.903378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130d774b7c364c3b81fa879a154a1ec3', 'request_id': 'req-df5dfb2e-662e-44f5-803a-d3d031fdad07'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:35.911304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130d774b7c364c3b81fa879a154a1ec3', 'request_id': 'req-df5dfb2e-662e-44f5-803a-d3d031fdad07'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:35.921816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] The token cache is being invalidate because project 130d774b7c364c3b81fa879a154a1ec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:35.922104 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:35.922980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-df5dfb2e-662e-44f5-803a-d3d031fdad07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:35.924831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1340/2681] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:35 2022] DELETE /identity/v3/projects/130d774b7c364c3b81fa879a154a1ec3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:35.931201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b66a1-2c97-48e8-896d-925825e755b0 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:35.931494 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b66a1-2c97-48e8-896d-925825e755b0 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:35.931804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b66a1-2c97-48e8-896d-925825e755b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:35.950860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-ec1b66a1-2c97-48e8-896d-925825e755b0 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:35.952129 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ec1b66a1-2c97-48e8-896d-925825e755b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:36.011368 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1342/2682] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:36.019593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48798a1-b796-4a12-b111-fd9ab860cc22 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.019593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48798a1-b796-4a12-b111-fd9ab860cc22 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.019931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48798a1-b796-4a12-b111-fd9ab860cc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.039706 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d48798a1-b796-4a12-b111-fd9ab860cc22 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:36.040923 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d48798a1-b796-4a12-b111-fd9ab860cc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:36.050403 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1341/2683] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:36.054828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b66a1-2c97-48e8-896d-925825e755b0 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.066588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b66a1-2c97-48e8-896d-925825e755b0 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.073361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624a558-8e84-4895-bc0a-cfa61d529366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.074155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624a558-8e84-4895-bc0a-cfa61d529366 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.074709 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624a558-8e84-4895-bc0a-cfa61d529366 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.074997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624a558-8e84-4895-bc0a-cfa61d529366 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.075841 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624a558-8e84-4895-bc0a-cfa61d529366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:36.076153 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624a558-8e84-4895-bc0a-cfa61d529366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.077839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624a558-8e84-4895-bc0a-cfa61d529366 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.092803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1343/2684] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:56:36.097107 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48798a1-b796-4a12-b111-fd9ab860cc22 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.106700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48798a1-b796-4a12-b111-fd9ab860cc22 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.111652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ad59-6d65-43e7-8d6b-e6feedaaaf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.112309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ad59-6d65-43e7-8d6b-e6feedaaaf5e admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.112597 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ad59-6d65-43e7-8d6b-e6feedaaaf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.112876 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ad59-6d65-43e7-8d6b-e6feedaaaf5e admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.113628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8ad59-6d65-43e7-8d6b-e6feedaaaf5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.115528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8ad59-6d65-43e7-8d6b-e6feedaaaf5e admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.159193 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1342/2685] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:36 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:36.160265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624a558-8e84-4895-bc0a-cfa61d529366 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.172858 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624a558-8e84-4895-bc0a-cfa61d529366 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.244477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991ab8-a57f-41da-8e8c-7cbbd71423ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.245154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991ab8-a57f-41da-8e8c-7cbbd71423ae admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.245436 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991ab8-a57f-41da-8e8c-7cbbd71423ae admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.245713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33991ab8-a57f-41da-8e8c-7cbbd71423ae admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.246421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33991ab8-a57f-41da-8e8c-7cbbd71423ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.248996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33991ab8-a57f-41da-8e8c-7cbbd71423ae admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.275780 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1344/2686] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:36 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:36.281373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ad59-6d65-43e7-8d6b-e6feedaaaf5e admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.290673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ad59-6d65-43e7-8d6b-e6feedaaaf5e admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.295425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3094d7-44c6-40c5-b576-dd79b7102c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.296138 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3094d7-44c6-40c5-b576-dd79b7102c3c admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.296426 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3094d7-44c6-40c5-b576-dd79b7102c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.296703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3094d7-44c6-40c5-b576-dd79b7102c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.297446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3094d7-44c6-40c5-b576-dd79b7102c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.299067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3094d7-44c6-40c5-b576-dd79b7102c3c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.313699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1343/2687] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:36.319022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991ab8-a57f-41da-8e8c-7cbbd71423ae admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.329989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33991ab8-a57f-41da-8e8c-7cbbd71423ae admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.336605 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0f3a-fe6b-4664-8873-9295ebe36ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.337442 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0f3a-fe6b-4664-8873-9295ebe36ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.337807 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0f3a-fe6b-4664-8873-9295ebe36ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.338100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0f3a-fe6b-4664-8873-9295ebe36ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.338892 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c0f3a-fe6b-4664-8873-9295ebe36ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.340578 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c0f3a-fe6b-4664-8873-9295ebe36ef5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.356778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1345/2688] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:36.361673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3094d7-44c6-40c5-b576-dd79b7102c3c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.376284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3094d7-44c6-40c5-b576-dd79b7102c3c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.382501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b17a8-a931-413e-b942-62e3515b7b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.383707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b17a8-a931-413e-b942-62e3515b7b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.384210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b17a8-a931-413e-b942-62e3515b7b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.384932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b17a8-a931-413e-b942-62e3515b7b46 admin admin] PATH_INFO: `/v3/projects/2ea7c48a7898499b8473ea698fa4fe5e/users/46af4092d3d74d64835197d1a79c4ec7/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.404738 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b17a8-a931-413e-b942-62e3515b7b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea7c48a7898499b8473ea698fa4fe5e, user_id=46af4092d3d74d64835197d1a79c4ec7, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.407379 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378b17a8-a931-413e-b942-62e3515b7b46 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.425984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1344/2689] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:36 2022] PUT /identity/v3/projects/2ea7c48a7898499b8473ea698fa4fe5e/users/46af4092d3d74d64835197d1a79c4ec7/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:36.438566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a114ab6-c531-4cef-8113-436989bd7b44 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.438861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a114ab6-c531-4cef-8113-436989bd7b44 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.439146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a114ab6-c531-4cef-8113-436989bd7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.482421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-2a114ab6-c531-4cef-8113-436989bd7b44 None None] MFA Rules not processed for user `46af4092d3d74d64835197d1a79c4ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:36.483704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2a114ab6-c531-4cef-8113-436989bd7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:36.562642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1346/2690] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:36.567449 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b17a8-a931-413e-b942-62e3515b7b46 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.648845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b17a8-a931-413e-b942-62e3515b7b46 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.653634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117b6ed-4547-4bb6-84ee-0cfd3f40f199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.654300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117b6ed-4547-4bb6-84ee-0cfd3f40f199 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.654584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117b6ed-4547-4bb6-84ee-0cfd3f40f199 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.654866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117b6ed-4547-4bb6-84ee-0cfd3f40f199 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.655583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117b6ed-4547-4bb6-84ee-0cfd3f40f199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.657680 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117b6ed-4547-4bb6-84ee-0cfd3f40f199 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.684048 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1345/2691] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:36 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:36.687934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a114ab6-c531-4cef-8113-436989bd7b44 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.699253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a114ab6-c531-4cef-8113-436989bd7b44 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.759927 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d4162-95b4-4ef2-ba7e-9bf11914690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.760620 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d4162-95b4-4ef2-ba7e-9bf11914690c admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.760907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d4162-95b4-4ef2-ba7e-9bf11914690c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.761188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d4162-95b4-4ef2-ba7e-9bf11914690c admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.761914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d4162-95b4-4ef2-ba7e-9bf11914690c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.763874 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d4162-95b4-4ef2-ba7e-9bf11914690c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.787220 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1347/2692] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:36 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:36.791151 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117b6ed-4547-4bb6-84ee-0cfd3f40f199 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.802525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117b6ed-4547-4bb6-84ee-0cfd3f40f199 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.807256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f4907-a49e-4474-9a44-f0f64d288097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.808024 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4907-a49e-4474-9a44-f0f64d288097 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.808309 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4907-a49e-4474-9a44-f0f64d288097 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.808634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f4907-a49e-4474-9a44-f0f64d288097 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.809378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f4907-a49e-4474-9a44-f0f64d288097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.810974 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f4907-a49e-4474-9a44-f0f64d288097 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.822541 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1346/2693] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:36.826613 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d4162-95b4-4ef2-ba7e-9bf11914690c admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.837058 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d4162-95b4-4ef2-ba7e-9bf11914690c admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.842512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf5c13-dc04-4ee3-ab7d-2dd00a98c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.843411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5c13-dc04-4ee3-ab7d-2dd00a98c8b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.843729 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5c13-dc04-4ee3-ab7d-2dd00a98c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.844016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5c13-dc04-4ee3-ab7d-2dd00a98c8b4 admin admin] PATH_INFO: `/v3/projects/d6b1bdbb67ad41fda0396c9119be660b/users/2081b74b6d2242f9a30de19722af14e2/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.861323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf5c13-dc04-4ee3-ab7d-2dd00a98c8b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b1bdbb67ad41fda0396c9119be660b, user_id=2081b74b6d2242f9a30de19722af14e2, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.864822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf5c13-dc04-4ee3-ab7d-2dd00a98c8b4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.880410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1348/2694] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:36 2022] PUT /identity/v3/projects/d6b1bdbb67ad41fda0396c9119be660b/users/2081b74b6d2242f9a30de19722af14e2/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:36.884481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f4907-a49e-4474-9a44-f0f64d288097 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:36.899395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f4907-a49e-4474-9a44-f0f64d288097 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:36.974914 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937a911-1651-4375-a639-a27e18fafe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:36.975626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a911-1651-4375-a639-a27e18fafe4d admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:36.975912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a911-1651-4375-a639-a27e18fafe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:36.976191 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937a911-1651-4375-a639-a27e18fafe4d admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:36.977067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937a911-1651-4375-a639-a27e18fafe4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:36.978671 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937a911-1651-4375-a639-a27e18fafe4d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:36.989742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1347/2695] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:36.994060 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf5c13-dc04-4ee3-ab7d-2dd00a98c8b4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:37.011782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf5c13-dc04-4ee3-ab7d-2dd00a98c8b4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:37.016707 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f626f5b-6c3d-4cfd-9840-b67fb10163dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:37.018131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f626f5b-6c3d-4cfd-9840-b67fb10163dc admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:37.018131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f626f5b-6c3d-4cfd-9840-b67fb10163dc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:37.018388 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f626f5b-6c3d-4cfd-9840-b67fb10163dc admin admin] PATH_INFO: `/v3/projects/d6b1bdbb67ad41fda0396c9119be660b/users/2081b74b6d2242f9a30de19722af14e2/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:37.021580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f626f5b-6c3d-4cfd-9840-b67fb10163dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b1bdbb67ad41fda0396c9119be660b, user_id=2081b74b6d2242f9a30de19722af14e2, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:37.024458 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f626f5b-6c3d-4cfd-9840-b67fb10163dc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:37.045762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1349/2696] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:36 2022] PUT /identity/v3/projects/d6b1bdbb67ad41fda0396c9119be660b/users/2081b74b6d2242f9a30de19722af14e2/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:37.061214 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037410-92e5-404a-8c7c-f185933313db None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:37.061681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037410-92e5-404a-8c7c-f185933313db None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:37.061802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc037410-92e5-404a-8c7c-f185933313db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:37.088867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-cc037410-92e5-404a-8c7c-f185933313db None None] MFA Rules not processed for user `2081b74b6d2242f9a30de19722af14e2`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:37.090253 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cc037410-92e5-404a-8c7c-f185933313db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:37.180534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1348/2697] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:37.192787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f626f5b-6c3d-4cfd-9840-b67fb10163dc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:37.195119 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0f626f5b-6c3d-4cfd-9840-b67fb10163dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:37.253551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f626f5b-6c3d-4cfd-9840-b67fb10163dc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:37.259127 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4831a7c-5ca7-4847-bf20-343d59c6010a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:37.260101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4831a7c-5ca7-4847-bf20-343d59c6010a service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:37.260512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4831a7c-5ca7-4847-bf20-343d59c6010a service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:37.260696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4831a7c-5ca7-4847-bf20-343d59c6010a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:37.270271 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4831a7c-5ca7-4847-bf20-343d59c6010a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:37.271774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4831a7c-5ca7-4847-bf20-343d59c6010a service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:37.285752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1350/2698] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:37.356441 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037410-92e5-404a-8c7c-f185933313db None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:37.366245 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc037410-92e5-404a-8c7c-f185933313db None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:37.369860 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1814453-af9f-4f3d-953d-49408f58ac7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:37.370499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814453-af9f-4f3d-953d-49408f58ac7d service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:37.370785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814453-af9f-4f3d-953d-49408f58ac7d service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:37.371090 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1814453-af9f-4f3d-953d-49408f58ac7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:37.425344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1814453-af9f-4f3d-953d-49408f58ac7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:37.427335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1814453-af9f-4f3d-953d-49408f58ac7d service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:37.436238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1349/2699] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:38.081989 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4831a7c-5ca7-4847-bf20-343d59c6010a service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:38.084121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e4831a7c-5ca7-4847-bf20-343d59c6010a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:38.150030 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4831a7c-5ca7-4847-bf20-343d59c6010a service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:38.154635 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:38.155513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:38.155827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:38.156109 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] PATH_INFO: `/v3/users/7d0f4753571748109d4dfd64d94de9e1` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:38.157308 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d0f4753571748109d4dfd64d94de9e1)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:38.159267 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:38.212604 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d0f4753571748109d4dfd64d94de9e1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.220232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d0f4753571748109d4dfd64d94de9e1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.232751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d0f4753571748109d4dfd64d94de9e1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.240753 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d0f4753571748109d4dfd64d94de9e1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.241888 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d0f4753571748109d4dfd64d94de9e1'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.251152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1351/2700] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:38 2022] DELETE /identity/v3/users/7d0f4753571748109d4dfd64d94de9e1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:38.253210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b103d1f-6f8c-41da-ba40-b0656f4766c0 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:38.253705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b103d1f-6f8c-41da-ba40-b0656f4766c0 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:38.254731 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b103d1f-6f8c-41da-ba40-b0656f4766c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:38.273685 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-0b103d1f-6f8c-41da-ba40-b0656f4766c0 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:38.275015 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0b103d1f-6f8c-41da-ba40-b0656f4766c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:38.334617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1350/2701] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:38.345713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:38.347248 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:38.406214 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741fd34-5d62-466c-87e1-0950d71531d1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:38.410172 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672da16-4d6e-446c-84fc-cd28758522a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:38.411527 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672da16-4d6e-446c-84fc-cd28758522a0 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:38.411942 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672da16-4d6e-446c-84fc-cd28758522a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:38.412324 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672da16-4d6e-446c-84fc-cd28758522a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:38.422410 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672da16-4d6e-446c-84fc-cd28758522a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:38.424101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672da16-4d6e-446c-84fc-cd28758522a0 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:38.435748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1352/2702] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:38.773717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b103d1f-6f8c-41da-ba40-b0656f4766c0 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:38.776635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-0b103d1f-6f8c-41da-ba40-b0656f4766c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:38.814378 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b103d1f-6f8c-41da-ba40-b0656f4766c0 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:38.843504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:38.843504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:38.843504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:38.843504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] PATH_INFO: `/v3/projects/bcdb84837f2f448cbbcfc66d6f2c455f` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:38.844444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdb84837f2f448cbbcfc66d6f2c455f)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:38.844444 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:38.906812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdb84837f2f448cbbcfc66d6f2c455f', 'request_id': 'req-5da74973-b1bd-4eef-a0e3-3c584521bea0'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.921058 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdb84837f2f448cbbcfc66d6f2c455f', 'request_id': 'req-5da74973-b1bd-4eef-a0e3-3c584521bea0'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.930235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdb84837f2f448cbbcfc66d6f2c455f', 'request_id': 'req-5da74973-b1bd-4eef-a0e3-3c584521bea0'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.943954 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] The token cache is being invalidate because project bcdb84837f2f448cbbcfc66d6f2c455f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:38.944739 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.945763 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:38.948840 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1351/2703] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:38 2022] DELETE /identity/v3/projects/bcdb84837f2f448cbbcfc66d6f2c455f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:38.952943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672da16-4d6e-446c-84fc-cd28758522a0 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:38.969943 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672da16-4d6e-446c-84fc-cd28758522a0 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:39.054018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:39.055140 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:39.055513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:39.055889 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] PATH_INFO: `/v3/users/608745c832574f1683be4c12b2643aed` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:39.058543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=608745c832574f1683be4c12b2643aed)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:39.059738 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:39.121770 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608745c832574f1683be4c12b2643aed'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.136657 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608745c832574f1683be4c12b2643aed'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.156771 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608745c832574f1683be4c12b2643aed'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.165182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608745c832574f1683be4c12b2643aed'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.166563 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-15203490-ee99-4860-b192-c78e9ff2b227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608745c832574f1683be4c12b2643aed'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.173190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1353/2704] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:38 2022] DELETE /identity/v3/users/608745c832574f1683be4c12b2643aed => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:39.454756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:39.457991 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:39.488335 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da74973-b1bd-4eef-a0e3-3c584521bea0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:39.563349 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:39.564547 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:39.565027 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:39.565319 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] PATH_INFO: `/v3/projects/3e40ecb4666046ae8a1c2867c7d3fcbe` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:39.567177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e40ecb4666046ae8a1c2867c7d3fcbe)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:39.569341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:39.622128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e40ecb4666046ae8a1c2867c7d3fcbe', 'request_id': 'req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.630424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e40ecb4666046ae8a1c2867c7d3fcbe', 'request_id': 'req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.637604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e40ecb4666046ae8a1c2867c7d3fcbe', 'request_id': 'req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.650888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] The token cache is being invalidate because project 3e40ecb4666046ae8a1c2867c7d3fcbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:39.651179 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.651881 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-00f943e6-39a4-44cf-9494-2bfe8d67b8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:39.653698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1352/2705] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:39 2022] DELETE /identity/v3/projects/3e40ecb4666046ae8a1c2867c7d3fcbe => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:39.659474 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653df01-407e-4fb9-99db-eabf7ac2f850 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:39.659972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653df01-407e-4fb9-99db-eabf7ac2f850 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:39.660218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653df01-407e-4fb9-99db-eabf7ac2f850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:39.681837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-d653df01-407e-4fb9-99db-eabf7ac2f850 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:39.683437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d653df01-407e-4fb9-99db-eabf7ac2f850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:39.753810 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1354/2706] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:39.762771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c568-ccc1-4089-a2c1-e3138efb5b51 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:39.763268 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c568-ccc1-4089-a2c1-e3138efb5b51 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:39.763553 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c568-ccc1-4089-a2c1-e3138efb5b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:39.789386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-f744c568-ccc1-4089-a2c1-e3138efb5b51 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:39.792011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f744c568-ccc1-4089-a2c1-e3138efb5b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:39.802063 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1353/2707] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:39.806672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653df01-407e-4fb9-99db-eabf7ac2f850 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:39.821902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653df01-407e-4fb9-99db-eabf7ac2f850 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:39.827789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123d959-b03a-4053-b3b8-ecc9525b8c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:39.828728 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123d959-b03a-4053-b3b8-ecc9525b8c76 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:39.829213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123d959-b03a-4053-b3b8-ecc9525b8c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:39.829677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123d959-b03a-4053-b3b8-ecc9525b8c76 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:39.830443 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123d959-b03a-4053-b3b8-ecc9525b8c76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:39.830755 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123d959-b03a-4053-b3b8-ecc9525b8c76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:39.833077 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123d959-b03a-4053-b3b8-ecc9525b8c76 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:39.845981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1355/2708] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:56:39.850528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c568-ccc1-4089-a2c1-e3138efb5b51 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:39.860656 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c568-ccc1-4089-a2c1-e3138efb5b51 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:39.867907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430c7bd-0d54-489e-a8bc-84fc0b81023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:39.867907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430c7bd-0d54-489e-a8bc-84fc0b81023d admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:39.868192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430c7bd-0d54-489e-a8bc-84fc0b81023d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:39.868506 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430c7bd-0d54-489e-a8bc-84fc0b81023d admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:39.869340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430c7bd-0d54-489e-a8bc-84fc0b81023d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:39.871588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430c7bd-0d54-489e-a8bc-84fc0b81023d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:39.902028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1354/2709] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:39 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:39.906936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123d959-b03a-4053-b3b8-ecc9525b8c76 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:39.925296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123d959-b03a-4053-b3b8-ecc9525b8c76 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:39.986949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271249b-f016-4192-b47c-21c7f0f4a421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:39.987831 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271249b-f016-4192-b47c-21c7f0f4a421 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:39.988218 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271249b-f016-4192-b47c-21c7f0f4a421 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:39.989483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271249b-f016-4192-b47c-21c7f0f4a421 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:39.990222 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271249b-f016-4192-b47c-21c7f0f4a421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:39.993701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271249b-f016-4192-b47c-21c7f0f4a421 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.018721 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1356/2710] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:39 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:40.023620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430c7bd-0d54-489e-a8bc-84fc0b81023d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.039290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430c7bd-0d54-489e-a8bc-84fc0b81023d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.045939 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4978251-7acf-4c33-82b2-a54c1b1968b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.047303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4978251-7acf-4c33-82b2-a54c1b1968b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.047682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4978251-7acf-4c33-82b2-a54c1b1968b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.048028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4978251-7acf-4c33-82b2-a54c1b1968b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.049111 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4978251-7acf-4c33-82b2-a54c1b1968b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.050733 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4978251-7acf-4c33-82b2-a54c1b1968b0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.062948 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1355/2711] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:40.066953 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271249b-f016-4192-b47c-21c7f0f4a421 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.077112 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271249b-f016-4192-b47c-21c7f0f4a421 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.081872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb8c39-97c0-4947-ac15-7c3f1c34b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.083359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb8c39-97c0-4947-ac15-7c3f1c34b019 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.083673 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb8c39-97c0-4947-ac15-7c3f1c34b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.084076 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb8c39-97c0-4947-ac15-7c3f1c34b019 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.084833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb8c39-97c0-4947-ac15-7c3f1c34b019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.086434 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb8c39-97c0-4947-ac15-7c3f1c34b019 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.096619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1357/2712] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:40.101599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4978251-7acf-4c33-82b2-a54c1b1968b0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.112124 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4978251-7acf-4c33-82b2-a54c1b1968b0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.117854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a0135-1fe6-4ce0-a403-47033773f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.118920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a0135-1fe6-4ce0-a403-47033773f5d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.119197 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a0135-1fe6-4ce0-a403-47033773f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.119478 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a0135-1fe6-4ce0-a403-47033773f5d8 admin admin] PATH_INFO: `/v3/projects/d46b167f4490482092ff97e6f47c4e01/users/722a80a1fd97478d80ba4a9aad54753d/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.134249 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a0135-1fe6-4ce0-a403-47033773f5d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46b167f4490482092ff97e6f47c4e01, user_id=722a80a1fd97478d80ba4a9aad54753d, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.137177 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a0135-1fe6-4ce0-a403-47033773f5d8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.163018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1356/2713] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:40 2022] PUT /identity/v3/projects/d46b167f4490482092ff97e6f47c4e01/users/722a80a1fd97478d80ba4a9aad54753d/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:40.165362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86df4ab-5158-4baf-b7b2-cc5633153fe5 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.165792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86df4ab-5158-4baf-b7b2-cc5633153fe5 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.166279 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86df4ab-5158-4baf-b7b2-cc5633153fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.210188 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-a86df4ab-5158-4baf-b7b2-cc5633153fe5 None None] MFA Rules not processed for user `722a80a1fd97478d80ba4a9aad54753d`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:40.211685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a86df4ab-5158-4baf-b7b2-cc5633153fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.271601 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a0135-1fe6-4ce0-a403-47033773f5d8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.274364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ba2a0135-1fe6-4ce0-a403-47033773f5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.319046 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1358/2714] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:40.323712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86df4ab-5158-4baf-b7b2-cc5633153fe5 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.356790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a0135-1fe6-4ce0-a403-47033773f5d8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.362842 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.363785 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.364069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.364347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] PATH_INFO: `/v3/users/d1189e6ca83149dc95cc1a54c3c31421` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.365563 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1189e6ca83149dc95cc1a54c3c31421)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.367483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.392064 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86df4ab-5158-4baf-b7b2-cc5633153fe5 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.398278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982e18d-8ec7-4238-8bb7-dda8b3f6eabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.398937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982e18d-8ec7-4238-8bb7-dda8b3f6eabb admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.399255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982e18d-8ec7-4238-8bb7-dda8b3f6eabb admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.399604 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982e18d-8ec7-4238-8bb7-dda8b3f6eabb admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.400440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982e18d-8ec7-4238-8bb7-dda8b3f6eabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.402532 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982e18d-8ec7-4238-8bb7-dda8b3f6eabb admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.415157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1189e6ca83149dc95cc1a54c3c31421'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.421898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1189e6ca83149dc95cc1a54c3c31421'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.422583 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1189e6ca83149dc95cc1a54c3c31421'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.427973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1359/2715] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:40 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:40.429090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982e18d-8ec7-4238-8bb7-dda8b3f6eabb admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.432253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a982e18d-8ec7-4238-8bb7-dda8b3f6eabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.434373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1189e6ca83149dc95cc1a54c3c31421'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.442604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1189e6ca83149dc95cc1a54c3c31421'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.448696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1357/2716] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:40 2022] DELETE /identity/v3/users/d1189e6ca83149dc95cc1a54c3c31421 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:40.449499 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.450829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.507398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982e18d-8ec7-4238-8bb7-dda8b3f6eabb admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.521498 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70478d1-f135-4e37-84d7-06373af85217 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.526280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ea598-e067-4228-8f13-c4aa02d42b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.526960 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ea598-e067-4228-8f13-c4aa02d42b66 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.527433 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ea598-e067-4228-8f13-c4aa02d42b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.527761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ea598-e067-4228-8f13-c4aa02d42b66 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.528999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ea598-e067-4228-8f13-c4aa02d42b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.530931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ea598-e067-4228-8f13-c4aa02d42b66 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.554934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1358/2717] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:40 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:40.558443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ea598-e067-4228-8f13-c4aa02d42b66 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.569390 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ea598-e067-4228-8f13-c4aa02d42b66 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.574418 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2d010-2c05-4023-a784-857a7d494db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.575084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2d010-2c05-4023-a784-857a7d494db5 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.575362 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2d010-2c05-4023-a784-857a7d494db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.575674 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2d010-2c05-4023-a784-857a7d494db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.576415 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2d010-2c05-4023-a784-857a7d494db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.577292 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.578013 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2d010-2c05-4023-a784-857a7d494db5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.578297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.578672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.579131 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] PATH_INFO: `/v3/users/46af4092d3d74d64835197d1a79c4ec7` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.580277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=46af4092d3d74d64835197d1a79c4ec7)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.583173 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.589366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1359/2718] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:40.593332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2d010-2c05-4023-a784-857a7d494db5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.602955 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2d010-2c05-4023-a784-857a7d494db5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.608017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ce6a3-e47e-4625-88e2-e7777748fdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.608977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ce6a3-e47e-4625-88e2-e7777748fdf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.609240 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ce6a3-e47e-4625-88e2-e7777748fdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.609670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ce6a3-e47e-4625-88e2-e7777748fdf5 admin admin] PATH_INFO: `/v3/projects/5d858fa7cbe14fb0b5764b2e7972009e/users/1d9bbadc52c643269bbfe46367cc400c/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.632341 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ce6a3-e47e-4625-88e2-e7777748fdf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d858fa7cbe14fb0b5764b2e7972009e, user_id=1d9bbadc52c643269bbfe46367cc400c, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.635554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ce6a3-e47e-4625-88e2-e7777748fdf5 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.635988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46af4092d3d74d64835197d1a79c4ec7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.646022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46af4092d3d74d64835197d1a79c4ec7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.658843 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46af4092d3d74d64835197d1a79c4ec7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.659336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1360/2719] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:40 2022] PUT /identity/v3/projects/5d858fa7cbe14fb0b5764b2e7972009e/users/1d9bbadc52c643269bbfe46367cc400c/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:40.663007 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ce6a3-e47e-4625-88e2-e7777748fdf5 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.665255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-041ce6a3-e47e-4625-88e2-e7777748fdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.667362 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46af4092d3d74d64835197d1a79c4ec7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.669008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46af4092d3d74d64835197d1a79c4ec7'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.675952 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1360/2720] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:40 2022] DELETE /identity/v3/users/46af4092d3d74d64835197d1a79c4ec7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:40.676875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.678215 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.732322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ce6a3-e47e-4625-88e2-e7777748fdf5 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.737004 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.737854 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.738138 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.738461 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] PATH_INFO: `/v3/projects/5c13f9d51cfe44de91903d2de6032c92` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.739704 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c13f9d51cfe44de91903d2de6032c92)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.740964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845207d4-33ab-4ddf-add0-3dd409a8c49b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.741595 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.746020 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d907d-bfad-4bc4-8340-482fe35ce817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.746685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d907d-bfad-4bc4-8340-482fe35ce817 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.746969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d907d-bfad-4bc4-8340-482fe35ce817 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.747243 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d907d-bfad-4bc4-8340-482fe35ce817 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.748009 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d907d-bfad-4bc4-8340-482fe35ce817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.749579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d907d-bfad-4bc4-8340-482fe35ce817 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.763157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1361/2721] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:40.763157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b5b6-c737-48d6-b924-f629a58b2e25 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.763157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b5b6-c737-48d6-b924-f629a58b2e25 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.763157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27b5b6-c737-48d6-b924-f629a58b2e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.780253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7a27b5b6-c737-48d6-b924-f629a58b2e25 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:40.781450 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7a27b5b6-c737-48d6-b924-f629a58b2e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.789756 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c13f9d51cfe44de91903d2de6032c92', 'request_id': 'req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.797236 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c13f9d51cfe44de91903d2de6032c92', 'request_id': 'req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.804250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c13f9d51cfe44de91903d2de6032c92', 'request_id': 'req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.814264 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] The token cache is being invalidate because project 5c13f9d51cfe44de91903d2de6032c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:40.814559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.815216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.817827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1361/2722] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:40 2022] DELETE /identity/v3/projects/5c13f9d51cfe44de91903d2de6032c92 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:40.818442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.819820 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.838483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1362/2723] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:40.841819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27b5b6-c737-48d6-b924-f629a58b2e25 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.841819 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7a27b5b6-c737-48d6-b924-f629a58b2e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.853359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27b5b6-c737-48d6-b924-f629a58b2e25 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.857996 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.858853 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.859135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.859413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] PATH_INFO: `/v3/users/69c74a11c13a4f6e8155bf109d9015d0` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.860652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c74a11c13a4f6e8155bf109d9015d0)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.862551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.882844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837ed0b-ddbf-4fd9-acf2-311eb42b7c80 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.887760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e45301-f105-4c14-a9f7-b8bc5ac2ad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:40.888739 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e45301-f105-4c14-a9f7-b8bc5ac2ad32 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.889109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e45301-f105-4c14-a9f7-b8bc5ac2ad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.889398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e45301-f105-4c14-a9f7-b8bc5ac2ad32 admin admin] PATH_INFO: `/v3/projects/5d858fa7cbe14fb0b5764b2e7972009e/users/1d9bbadc52c643269bbfe46367cc400c/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.891619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e45301-f105-4c14-a9f7-b8bc5ac2ad32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d858fa7cbe14fb0b5764b2e7972009e, user_id=1d9bbadc52c643269bbfe46367cc400c, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:40.894393 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e45301-f105-4c14-a9f7-b8bc5ac2ad32 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:40.905468 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1362/2724] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:40 2022] PUT /identity/v3/projects/5d858fa7cbe14fb0b5764b2e7972009e/users/1d9bbadc52c643269bbfe46367cc400c/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:40.906183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e45301-f105-4c14-a9f7-b8bc5ac2ad32 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:40.907805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-63e45301-f105-4c14-a9f7-b8bc5ac2ad32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:40.916152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c74a11c13a4f6e8155bf109d9015d0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.922893 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c74a11c13a4f6e8155bf109d9015d0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.934894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c74a11c13a4f6e8155bf109d9015d0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.942413 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c74a11c13a4f6e8155bf109d9015d0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.943391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-de37546f-8c94-4510-b372-6b5efe5d6f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c74a11c13a4f6e8155bf109d9015d0'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:40.950324 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1363/2725] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:40 2022] DELETE /identity/v3/users/69c74a11c13a4f6e8155bf109d9015d0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:40.951787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206525-ad16-4893-b9ca-8b12d66cd2b4 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:40.952079 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206525-ad16-4893-b9ca-8b12d66cd2b4 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:40.952359 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d206525-ad16-4893-b9ca-8b12d66cd2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:40.965101 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e45301-f105-4c14-a9f7-b8bc5ac2ad32 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:40.984502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-5d206525-ad16-4893-b9ca-8b12d66cd2b4 None None] MFA Rules not processed for user `1d9bbadc52c643269bbfe46367cc400c`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:40.986355 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5d206525-ad16-4893-b9ca-8b12d66cd2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:41.021209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:41.021898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:41.022185 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:41.022484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:41.024300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:41.059086 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1364/2726] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:41.069742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d206525-ad16-4893-b9ca-8b12d66cd2b4 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:41.071199 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5d206525-ad16-4893-b9ca-8b12d66cd2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:41.100767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:41.102328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:41.114020 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1363/2727] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:41.130929 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d206525-ad16-4893-b9ca-8b12d66cd2b4 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:41.136012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0770f-5917-4ab7-bce6-230386c67823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:41.136854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0770f-5917-4ab7-bce6-230386c67823 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:41.137394 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0770f-5917-4ab7-bce6-230386c67823 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:41.137970 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0770f-5917-4ab7-bce6-230386c67823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:41.152036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0770f-5917-4ab7-bce6-230386c67823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:41.154165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0770f-5917-4ab7-bce6-230386c67823 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:41.166148 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1365/2728] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:41 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:41.167399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:41.169144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:41.189291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44ba1d-ac89-43a5-be5f-08ad8b1ddc1f service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:41.197592 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:41.199001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:41.199297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:41.199654 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] PATH_INFO: `/v3/projects/63cea5ab5c644c2ba6badb6d25b3dbdc` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:41.201247 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cea5ab5c644c2ba6badb6d25b3dbdc)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:41.203357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:41.268022 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0770f-5917-4ab7-bce6-230386c67823 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:41.277811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0770f-5917-4ab7-bce6-230386c67823 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:41.287304 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cea5ab5c644c2ba6badb6d25b3dbdc', 'request_id': 'req-388cb70f-b179-4d72-a918-7db03a257030'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.297400 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cea5ab5c644c2ba6badb6d25b3dbdc', 'request_id': 'req-388cb70f-b179-4d72-a918-7db03a257030'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.306635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cea5ab5c644c2ba6badb6d25b3dbdc', 'request_id': 'req-388cb70f-b179-4d72-a918-7db03a257030'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.319456 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] The token cache is being invalidate because project 63cea5ab5c644c2ba6badb6d25b3dbdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:41.319907 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.321462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.323248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1364/2729] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:41 2022] DELETE /identity/v3/projects/63cea5ab5c644c2ba6badb6d25b3dbdc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:41.339905 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becd71c-a2e1-41e8-b3c4-c175808c66c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:41.340584 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becd71c-a2e1-41e8-b3c4-c175808c66c4 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:41.340870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becd71c-a2e1-41e8-b3c4-c175808c66c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:41.341181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becd71c-a2e1-41e8-b3c4-c175808c66c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:41.343523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-5becd71c-a2e1-41e8-b3c4-c175808c66c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:41.411508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becd71c-a2e1-41e8-b3c4-c175808c66c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:41.412914 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becd71c-a2e1-41e8-b3c4-c175808c66c4 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:41.424189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1366/2730] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:56:41.456634 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:41.460638 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:41.549085 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cb70f-b179-4d72-a918-7db03a257030 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:41.555106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:41.556011 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:41.556292 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:41.556575 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] PATH_INFO: `/v3/projects/2ea7c48a7898499b8473ea698fa4fe5e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:41.557791 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea7c48a7898499b8473ea698fa4fe5e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:41.559812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:41.606619 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea7c48a7898499b8473ea698fa4fe5e', 'request_id': 'req-eb107dae-4e05-409a-97d6-c081a1c083f6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.613912 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea7c48a7898499b8473ea698fa4fe5e', 'request_id': 'req-eb107dae-4e05-409a-97d6-c081a1c083f6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.620333 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea7c48a7898499b8473ea698fa4fe5e', 'request_id': 'req-eb107dae-4e05-409a-97d6-c081a1c083f6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.630978 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] The token cache is being invalidate because project 2ea7c48a7898499b8473ea698fa4fe5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:41.631486 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.632570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.635100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1365/2731] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:41 2022] DELETE /identity/v3/projects/2ea7c48a7898499b8473ea698fa4fe5e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:41.639132 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becd71c-a2e1-41e8-b3c4-c175808c66c4 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:41.651314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becd71c-a2e1-41e8-b3c4-c175808c66c4 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:41.723590 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:41.725144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:41.725144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:41.725144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] PATH_INFO: `/v3/users/2081b74b6d2242f9a30de19722af14e2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:41.728072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2081b74b6d2242f9a30de19722af14e2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:41.728653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:41.780932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2081b74b6d2242f9a30de19722af14e2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.789291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2081b74b6d2242f9a30de19722af14e2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.803740 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2081b74b6d2242f9a30de19722af14e2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.812441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2081b74b6d2242f9a30de19722af14e2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.813277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-02521493-0047-4b77-ba33-74725ffb06de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2081b74b6d2242f9a30de19722af14e2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:41.822727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1367/2732] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:41 2022] DELETE /identity/v3/users/2081b74b6d2242f9a30de19722af14e2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:42.091589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.093047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:42.106176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb107dae-4e05-409a-97d6-c081a1c083f6 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.159438 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.160864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.161152 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.161423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] PATH_INFO: `/v3/projects/d6b1bdbb67ad41fda0396c9119be660b` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.162620 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b1bdbb67ad41fda0396c9119be660b)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.164560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:42.208689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b1bdbb67ad41fda0396c9119be660b', 'request_id': 'req-1973c7bc-556a-450e-8f41-13cffb9b4a1a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:42.215320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b1bdbb67ad41fda0396c9119be660b', 'request_id': 'req-1973c7bc-556a-450e-8f41-13cffb9b4a1a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:42.221542 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b1bdbb67ad41fda0396c9119be660b', 'request_id': 'req-1973c7bc-556a-450e-8f41-13cffb9b4a1a'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:42.232395 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] The token cache is being invalidate because project d6b1bdbb67ad41fda0396c9119be660b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:42.232683 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:42.233307 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1973c7bc-556a-450e-8f41-13cffb9b4a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:42.234816 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1366/2733] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:42 2022] DELETE /identity/v3/projects/d6b1bdbb67ad41fda0396c9119be660b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:42.241629 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482f75-1742-47e1-9988-5ecf548b2a58 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.241992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482f75-1742-47e1-9988-5ecf548b2a58 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.242343 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8482f75-1742-47e1-9988-5ecf548b2a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.260762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e8482f75-1742-47e1-9988-5ecf548b2a58 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:42.261947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e8482f75-1742-47e1-9988-5ecf548b2a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:42.318239 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1368/2734] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:42.327032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fed70-bda5-461f-ba7a-bb9222384a65 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.327337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fed70-bda5-461f-ba7a-bb9222384a65 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.327635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fed70-bda5-461f-ba7a-bb9222384a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.347158 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ad1fed70-bda5-461f-ba7a-bb9222384a65 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:42.348552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ad1fed70-bda5-461f-ba7a-bb9222384a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:42.358271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1367/2735] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:42.362547 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8482f75-1742-47e1-9988-5ecf548b2a58 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.372976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8482f75-1742-47e1-9988-5ecf548b2a58 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.377907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf5c80-5723-43ec-921d-50bdd8a82853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.378559 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf5c80-5723-43ec-921d-50bdd8a82853 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.378847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf5c80-5723-43ec-921d-50bdd8a82853 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.379799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf5c80-5723-43ec-921d-50bdd8a82853 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.380803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf5c80-5723-43ec-921d-50bdd8a82853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:42.381117 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf5c80-5723-43ec-921d-50bdd8a82853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.382717 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf5c80-5723-43ec-921d-50bdd8a82853 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:42.394350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1369/2736] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:56:42.398827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fed70-bda5-461f-ba7a-bb9222384a65 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.407837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fed70-bda5-461f-ba7a-bb9222384a65 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.412536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c180f1a-2b00-4150-8b5f-fdf2545211ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.413172 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c180f1a-2b00-4150-8b5f-fdf2545211ef admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.413453 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c180f1a-2b00-4150-8b5f-fdf2545211ef admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.413726 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c180f1a-2b00-4150-8b5f-fdf2545211ef admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.414425 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c180f1a-2b00-4150-8b5f-fdf2545211ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.416337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c180f1a-2b00-4150-8b5f-fdf2545211ef admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:42.441281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1368/2737] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:42 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:42.446633 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf5c80-5723-43ec-921d-50bdd8a82853 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.456457 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf5c80-5723-43ec-921d-50bdd8a82853 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.511142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77d06c-e10c-4bc3-8527-435521589748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.511764 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77d06c-e10c-4bc3-8527-435521589748 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.512048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77d06c-e10c-4bc3-8527-435521589748 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.512323 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77d06c-e10c-4bc3-8527-435521589748 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.513029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77d06c-e10c-4bc3-8527-435521589748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.514930 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77d06c-e10c-4bc3-8527-435521589748 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:42.534261 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1370/2738] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:42 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:42.538783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c180f1a-2b00-4150-8b5f-fdf2545211ef admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.551406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c180f1a-2b00-4150-8b5f-fdf2545211ef admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.556505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556929b6-7e3a-48f7-9042-054d4d556227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.557163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556929b6-7e3a-48f7-9042-054d4d556227 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.557445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556929b6-7e3a-48f7-9042-054d4d556227 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.557719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556929b6-7e3a-48f7-9042-054d4d556227 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.558449 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556929b6-7e3a-48f7-9042-054d4d556227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.560080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556929b6-7e3a-48f7-9042-054d4d556227 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:42.573717 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1369/2739] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:42.577934 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77d06c-e10c-4bc3-8527-435521589748 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.589073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77d06c-e10c-4bc3-8527-435521589748 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.593726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d1c60-e051-4552-8101-64b3cb1dc4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.594386 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d1c60-e051-4552-8101-64b3cb1dc4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.594672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d1c60-e051-4552-8101-64b3cb1dc4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.594954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d1c60-e051-4552-8101-64b3cb1dc4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.595734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d1c60-e051-4552-8101-64b3cb1dc4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.597348 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d1c60-e051-4552-8101-64b3cb1dc4e7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:42.607875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1371/2740] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:42.611823 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556929b6-7e3a-48f7-9042-054d4d556227 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.621732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556929b6-7e3a-48f7-9042-054d4d556227 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.626270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31790c-cd81-49ab-8933-4074f5856e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.627130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31790c-cd81-49ab-8933-4074f5856e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.627434 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31790c-cd81-49ab-8933-4074f5856e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.627740 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31790c-cd81-49ab-8933-4074f5856e4d admin admin] PATH_INFO: `/v3/projects/2b8bdc1d1a384ecabea074d0216dfc2b/users/99eab3bc1d8a455e8ffb4ab0ff541e8e/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.642244 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31790c-cd81-49ab-8933-4074f5856e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8bdc1d1a384ecabea074d0216dfc2b, user_id=99eab3bc1d8a455e8ffb4ab0ff541e8e, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.645411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e31790c-cd81-49ab-8933-4074f5856e4d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:42.657714 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1370/2741] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:42 2022] PUT /identity/v3/projects/2b8bdc1d1a384ecabea074d0216dfc2b/users/99eab3bc1d8a455e8ffb4ab0ff541e8e/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:42.668466 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5ea9-b037-49e3-a91d-24da549a1212 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.668762 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5ea9-b037-49e3-a91d-24da549a1212 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.669044 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5ea9-b037-49e3-a91d-24da549a1212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.695735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-f2ab5ea9-b037-49e3-a91d-24da549a1212 None None] MFA Rules not processed for user `99eab3bc1d8a455e8ffb4ab0ff541e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:42.696954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f2ab5ea9-b037-49e3-a91d-24da549a1212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:42.763361 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1372/2742] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:42.767507 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31790c-cd81-49ab-8933-4074f5856e4d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.831143 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31790c-cd81-49ab-8933-4074f5856e4d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.836604 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88d30-6a9e-4555-b635-626ceb2b4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.837256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88d30-6a9e-4555-b635-626ceb2b4eab admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.837550 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88d30-6a9e-4555-b635-626ceb2b4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.837843 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88d30-6a9e-4555-b635-626ceb2b4eab admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.838562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88d30-6a9e-4555-b635-626ceb2b4eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.840481 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88d30-6a9e-4555-b635-626ceb2b4eab admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:42.865818 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1371/2743] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:42 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:42.870237 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5ea9-b037-49e3-a91d-24da549a1212 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.882356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5ea9-b037-49e3-a91d-24da549a1212 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.940169 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3339c-bb5f-488b-a940-34e4eb1d1da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.940843 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3339c-bb5f-488b-a940-34e4eb1d1da8 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.941126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3339c-bb5f-488b-a940-34e4eb1d1da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.942018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3339c-bb5f-488b-a940-34e4eb1d1da8 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.942837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3339c-bb5f-488b-a940-34e4eb1d1da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.945206 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3339c-bb5f-488b-a940-34e4eb1d1da8 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:42.970529 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1373/2744] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:42 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:42.971796 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88d30-6a9e-4555-b635-626ceb2b4eab admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:42.982041 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88d30-6a9e-4555-b635-626ceb2b4eab admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:42.987284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e474f8e-1505-4aae-ba40-da5ef970aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:42.988036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474f8e-1505-4aae-ba40-da5ef970aa42 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:42.988327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474f8e-1505-4aae-ba40-da5ef970aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:42.988679 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e474f8e-1505-4aae-ba40-da5ef970aa42 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:42.989413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e474f8e-1505-4aae-ba40-da5ef970aa42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:42.991057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e474f8e-1505-4aae-ba40-da5ef970aa42 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:43.003599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1372/2745] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:43.007291 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3339c-bb5f-488b-a940-34e4eb1d1da8 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:43.017624 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3339c-bb5f-488b-a940-34e4eb1d1da8 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:43.022868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570285ce-dc9b-4fb2-95f1-9414064b7a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:43.023964 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570285ce-dc9b-4fb2-95f1-9414064b7a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:43.024253 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570285ce-dc9b-4fb2-95f1-9414064b7a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:43.024535 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570285ce-dc9b-4fb2-95f1-9414064b7a60 admin admin] PATH_INFO: `/v3/projects/f8f7db21423e466caf132d62c3918b9a/users/01144a03c1be4239b83a30812e8408fd/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:43.040779 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570285ce-dc9b-4fb2-95f1-9414064b7a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f7db21423e466caf132d62c3918b9a, user_id=01144a03c1be4239b83a30812e8408fd, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:43.043859 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570285ce-dc9b-4fb2-95f1-9414064b7a60 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:43.057685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1374/2746] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:43 2022] PUT /identity/v3/projects/f8f7db21423e466caf132d62c3918b9a/users/01144a03c1be4239b83a30812e8408fd/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:43.062073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e474f8e-1505-4aae-ba40-da5ef970aa42 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:43.073565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e474f8e-1505-4aae-ba40-da5ef970aa42 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:43.127647 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae8e76-5ae3-4f49-a0ee-6765519204c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:43.128311 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae8e76-5ae3-4f49-a0ee-6765519204c7 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:43.128598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae8e76-5ae3-4f49-a0ee-6765519204c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:43.129614 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae8e76-5ae3-4f49-a0ee-6765519204c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:43.130358 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae8e76-5ae3-4f49-a0ee-6765519204c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:43.131975 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae8e76-5ae3-4f49-a0ee-6765519204c7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:43.142032 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1373/2747] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:43.146145 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570285ce-dc9b-4fb2-95f1-9414064b7a60 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:43.156685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570285ce-dc9b-4fb2-95f1-9414064b7a60 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:43.161630 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60241731-d8fe-4182-ac79-73f57e766fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:43.162503 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60241731-d8fe-4182-ac79-73f57e766fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:43.162785 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60241731-d8fe-4182-ac79-73f57e766fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:43.163058 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60241731-d8fe-4182-ac79-73f57e766fe1 admin admin] PATH_INFO: `/v3/projects/f8f7db21423e466caf132d62c3918b9a/users/01144a03c1be4239b83a30812e8408fd/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:43.165036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60241731-d8fe-4182-ac79-73f57e766fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f7db21423e466caf132d62c3918b9a, user_id=01144a03c1be4239b83a30812e8408fd, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:43.167696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60241731-d8fe-4182-ac79-73f57e766fe1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:43.178099 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1375/2748] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:43 2022] PUT /identity/v3/projects/f8f7db21423e466caf132d62c3918b9a/users/01144a03c1be4239b83a30812e8408fd/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:43.188059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53d3c4-07d9-4aa6-bd7f-bae8dd9d4f71 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:43.188640 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53d3c4-07d9-4aa6-bd7f-bae8dd9d4f71 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:43.188925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53d3c4-07d9-4aa6-bd7f-bae8dd9d4f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:43.216386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-8c53d3c4-07d9-4aa6-bd7f-bae8dd9d4f71 None None] MFA Rules not processed for user `01144a03c1be4239b83a30812e8408fd`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:43.217566 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8c53d3c4-07d9-4aa6-bd7f-bae8dd9d4f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:43.282527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1374/2749] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:43.292297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60241731-d8fe-4182-ac79-73f57e766fe1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:43.293992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-60241731-d8fe-4182-ac79-73f57e766fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:43.348363 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60241731-d8fe-4182-ac79-73f57e766fe1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:43.352006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f72bd8-ef32-44ed-a865-00a53c1b70b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:43.352649 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f72bd8-ef32-44ed-a865-00a53c1b70b7 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:43.352931 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f72bd8-ef32-44ed-a865-00a53c1b70b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:43.353207 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f72bd8-ef32-44ed-a865-00a53c1b70b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:43.361804 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f72bd8-ef32-44ed-a865-00a53c1b70b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:43.363789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f72bd8-ef32-44ed-a865-00a53c1b70b7 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:43.373280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1376/2750] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:56:44.622006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53d3c4-07d9-4aa6-bd7f-bae8dd9d4f71 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:44.683535 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53d3c4-07d9-4aa6-bd7f-bae8dd9d4f71 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:44.688306 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:44.689201 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:44.689484 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:44.689762 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] PATH_INFO: `/v3/users/99eab3bc1d8a455e8ffb4ab0ff541e8e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:44.690989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99eab3bc1d8a455e8ffb4ab0ff541e8e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:44.693598 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:44.744262 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99eab3bc1d8a455e8ffb4ab0ff541e8e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:44.750713 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99eab3bc1d8a455e8ffb4ab0ff541e8e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:44.751375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99eab3bc1d8a455e8ffb4ab0ff541e8e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:44.763742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99eab3bc1d8a455e8ffb4ab0ff541e8e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:44.772204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99eab3bc1d8a455e8ffb4ab0ff541e8e'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:44.778144 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1375/2751] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:44 2022] DELETE /identity/v3/users/99eab3bc1d8a455e8ffb4ab0ff541e8e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:44.782610 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c6f3-5eef-4ff6-9759-996525fdec11 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:44.783794 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c6f3-5eef-4ff6-9759-996525fdec11 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:44.784149 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904c6f3-5eef-4ff6-9759-996525fdec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:44.803932 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-c904c6f3-5eef-4ff6-9759-996525fdec11 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:44.805135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c904c6f3-5eef-4ff6-9759-996525fdec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:44.864939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1377/2752] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:44.875030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:44.876689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:44.933829 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a0c7e-7634-4a1f-8310-7cc40c9f8a03 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:44.937505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa0783-020d-4d7e-91ee-899d3dde4081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:44.938148 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa0783-020d-4d7e-91ee-899d3dde4081 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:44.938435 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa0783-020d-4d7e-91ee-899d3dde4081 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:44.938716 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa0783-020d-4d7e-91ee-899d3dde4081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:44.949865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa0783-020d-4d7e-91ee-899d3dde4081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:44.951312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa0783-020d-4d7e-91ee-899d3dde4081 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:44.961979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1376/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:45.222407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c6f3-5eef-4ff6-9759-996525fdec11 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:45.224097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c904c6f3-5eef-4ff6-9759-996525fdec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:45.236972 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904c6f3-5eef-4ff6-9759-996525fdec11 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:45.241582 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:45.242704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:45.242992 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:45.243264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] PATH_INFO: `/v3/projects/2b8bdc1d1a384ecabea074d0216dfc2b` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:45.244523 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8bdc1d1a384ecabea074d0216dfc2b)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:45.246406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:45.295991 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8bdc1d1a384ecabea074d0216dfc2b', 'request_id': 'req-d1c5a3f5-94dc-4693-b44a-a24a18f32623'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.302447 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8bdc1d1a384ecabea074d0216dfc2b', 'request_id': 'req-d1c5a3f5-94dc-4693-b44a-a24a18f32623'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.307971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8bdc1d1a384ecabea074d0216dfc2b', 'request_id': 'req-d1c5a3f5-94dc-4693-b44a-a24a18f32623'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.320986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] The token cache is being invalidate because project 2b8bdc1d1a384ecabea074d0216dfc2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:45.321282 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.321950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.323484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1378/2754] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:45 2022] DELETE /identity/v3/projects/2b8bdc1d1a384ecabea074d0216dfc2b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:45.327577 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa0783-020d-4d7e-91ee-899d3dde4081 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:45.337128 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa0783-020d-4d7e-91ee-899d3dde4081 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:45.391117 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:45.391933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:45.392221 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:45.392502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] PATH_INFO: `/v3/users/01144a03c1be4239b83a30812e8408fd` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:45.393689 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01144a03c1be4239b83a30812e8408fd)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:45.395822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:45.438414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01144a03c1be4239b83a30812e8408fd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.445462 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01144a03c1be4239b83a30812e8408fd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.446130 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01144a03c1be4239b83a30812e8408fd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.457545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01144a03c1be4239b83a30812e8408fd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.464328 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-f7f98bc5-f708-400b-bf77-89f84898d204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01144a03c1be4239b83a30812e8408fd'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.469927 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1377/2755] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:45 2022] DELETE /identity/v3/users/01144a03c1be4239b83a30812e8408fd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:45.731919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:45.733462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:45.750514 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5a3f5-94dc-4693-b44a-a24a18f32623 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:45.806033 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:45.806887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:45.807171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:45.807449 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] PATH_INFO: `/v3/projects/f8f7db21423e466caf132d62c3918b9a` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:45.808664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f7db21423e466caf132d62c3918b9a)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:45.810569 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:45.853790 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f7db21423e466caf132d62c3918b9a', 'request_id': 'req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.859558 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f7db21423e466caf132d62c3918b9a', 'request_id': 'req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.865412 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f7db21423e466caf132d62c3918b9a', 'request_id': 'req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.877264 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] The token cache is being invalidate because project f8f7db21423e466caf132d62c3918b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:45.877561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.878174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cd5ab626-da98-4ec7-ac87-2c545ac6cb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:45.880562 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1379/2756] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:45 2022] DELETE /identity/v3/projects/f8f7db21423e466caf132d62c3918b9a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:45.886596 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828465-67e4-4aa7-b727-fedc183c2d4b None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:45.887079 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828465-67e4-4aa7-b727-fedc183c2d4b None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:45.887178 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b828465-67e4-4aa7-b727-fedc183c2d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:45.905833 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-6b828465-67e4-4aa7-b727-fedc183c2d4b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:45.907082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6b828465-67e4-4aa7-b727-fedc183c2d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:45.966942 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1378/2757] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:45.975152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ed59-729b-487a-984a-2fd098b061cc None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:45.975577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ed59-729b-487a-984a-2fd098b061cc None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:45.975921 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ed59-729b-487a-984a-2fd098b061cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:45.996280 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7709ed59-729b-487a-984a-2fd098b061cc None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:45.997481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7709ed59-729b-487a-984a-2fd098b061cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.006091 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1380/2758] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:46.010527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828465-67e4-4aa7-b727-fedc183c2d4b None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.020029 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b828465-67e4-4aa7-b727-fedc183c2d4b None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.024613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.025322 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.025624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.025888 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.026624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:46.026930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.028605 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.040494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1379/2759] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:56:46.045343 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ed59-729b-487a-984a-2fd098b061cc None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.055933 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ed59-729b-487a-984a-2fd098b061cc None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.063488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.063775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a007-2b81-4e44-9091-ba3e65e3a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.064769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a007-2b81-4e44-9091-ba3e65e3a114 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.065173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.065283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a007-2b81-4e44-9091-ba3e65e3a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.065451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a007-2b81-4e44-9091-ba3e65e3a114 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.066231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a007-2b81-4e44-9091-ba3e65e3a114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.068484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04a007-2b81-4e44-9091-ba3e65e3a114 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.077882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91a181-d76b-41a6-975f-6428cc387c4a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.083113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.084014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.084308 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.084579 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] PATH_INFO: `/v3/users/722a80a1fd97478d80ba4a9aad54753d` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.086086 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=722a80a1fd97478d80ba4a9aad54753d)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.088204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.094272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1381/2760] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:46 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:46.098411 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a007-2b81-4e44-9091-ba3e65e3a114 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.135171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722a80a1fd97478d80ba4a9aad54753d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.141677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722a80a1fd97478d80ba4a9aad54753d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.142357 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722a80a1fd97478d80ba4a9aad54753d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.154001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722a80a1fd97478d80ba4a9aad54753d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.158614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a007-2b81-4e44-9091-ba3e65e3a114 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.161568 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-51940b50-7cbf-4661-9a41-489018b82fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722a80a1fd97478d80ba4a9aad54753d'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.163712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d322d-3b60-4608-96f0-44c89fb5b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.164380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d322d-3b60-4608-96f0-44c89fb5b413 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.164669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d322d-3b60-4608-96f0-44c89fb5b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.164950 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d322d-3b60-4608-96f0-44c89fb5b413 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.165652 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d322d-3b60-4608-96f0-44c89fb5b413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.167380 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1380/2761] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:46 2022] DELETE /identity/v3/users/722a80a1fd97478d80ba4a9aad54753d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:46.167595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d322d-3b60-4608-96f0-44c89fb5b413 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.171971 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d8aaf-6937-4313-bc8c-86bc98164b0f None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.172267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d8aaf-6937-4313-bc8c-86bc98164b0f None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.172576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d8aaf-6937-4313-bc8c-86bc98164b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.190516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1382/2762] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:46 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:46.192246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d322d-3b60-4608-96f0-44c89fb5b413 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.192439 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-404d8aaf-6937-4313-bc8c-86bc98164b0f None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:46.193629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-404d8aaf-6937-4313-bc8c-86bc98164b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.193912 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-828d322d-3b60-4608-96f0-44c89fb5b413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.205599 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d322d-3b60-4608-96f0-44c89fb5b413 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.249641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1381/2763] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:46.259925 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f0a5d-b529-4697-a421-6237f4b52359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.260646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d8aaf-6937-4313-bc8c-86bc98164b0f None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.260769 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0a5d-b529-4697-a421-6237f4b52359 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.260954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0a5d-b529-4697-a421-6237f4b52359 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.261243 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0a5d-b529-4697-a421-6237f4b52359 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.261995 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f0a5d-b529-4697-a421-6237f4b52359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.262200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-404d8aaf-6937-4313-bc8c-86bc98164b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.263640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f0a5d-b529-4697-a421-6237f4b52359 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.274105 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1383/2764] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:46.277907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f0a5d-b529-4697-a421-6237f4b52359 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.288059 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f0a5d-b529-4697-a421-6237f4b52359 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.293176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdb8ed-91b7-4ff2-95a0-51379d06966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.293822 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdb8ed-91b7-4ff2-95a0-51379d06966f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.294111 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdb8ed-91b7-4ff2-95a0-51379d06966f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.294391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdb8ed-91b7-4ff2-95a0-51379d06966f admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.295121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdb8ed-91b7-4ff2-95a0-51379d06966f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.296773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdb8ed-91b7-4ff2-95a0-51379d06966f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.307402 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1384/2765] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:46.311469 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdb8ed-91b7-4ff2-95a0-51379d06966f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.318228 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d8aaf-6937-4313-bc8c-86bc98164b0f None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.321645 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdb8ed-91b7-4ff2-95a0-51379d06966f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.322682 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701496e-5a11-4013-98b8-fd68f555344c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.323327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701496e-5a11-4013-98b8-fd68f555344c service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.323631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701496e-5a11-4013-98b8-fd68f555344c service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.323909 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701496e-5a11-4013-98b8-fd68f555344c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.326519 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b7616-84e3-4893-9ca6-5f7acabe7fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.327383 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b7616-84e3-4893-9ca6-5f7acabe7fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.327735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b7616-84e3-4893-9ca6-5f7acabe7fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.328019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b7616-84e3-4893-9ca6-5f7acabe7fbc admin admin] PATH_INFO: `/v3/projects/8312debdd46c40138ce82ef860efd571/users/a348659d417a496dbb749bd2e9680cb6/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.334218 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701496e-5a11-4013-98b8-fd68f555344c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.335742 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701496e-5a11-4013-98b8-fd68f555344c service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.344139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b7616-84e3-4893-9ca6-5f7acabe7fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8312debdd46c40138ce82ef860efd571, user_id=a348659d417a496dbb749bd2e9680cb6, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.345000 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1382/2766] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:56:46.346868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b7616-84e3-4893-9ca6-5f7acabe7fbc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.360266 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1385/2767] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:46 2022] PUT /identity/v3/projects/8312debdd46c40138ce82ef860efd571/users/a348659d417a496dbb749bd2e9680cb6/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:46.370545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652da076-63a1-499c-bd6b-cabc2d4258ae None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.370859 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652da076-63a1-499c-bd6b-cabc2d4258ae None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.371176 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652da076-63a1-499c-bd6b-cabc2d4258ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.401459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-652da076-63a1-499c-bd6b-cabc2d4258ae None None] MFA Rules not processed for user `a348659d417a496dbb749bd2e9680cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:46.402813 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-652da076-63a1-499c-bd6b-cabc2d4258ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.469852 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1383/2768] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:46.474614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b7616-84e3-4893-9ca6-5f7acabe7fbc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.539751 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b7616-84e3-4893-9ca6-5f7acabe7fbc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.546272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53817b66-fd55-44d5-bc3a-8f6ffa49ad6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.546272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817b66-fd55-44d5-bc3a-8f6ffa49ad6b admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.546272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817b66-fd55-44d5-bc3a-8f6ffa49ad6b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.546272 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53817b66-fd55-44d5-bc3a-8f6ffa49ad6b admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.546902 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53817b66-fd55-44d5-bc3a-8f6ffa49ad6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.548908 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53817b66-fd55-44d5-bc3a-8f6ffa49ad6b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.577947 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1386/2769] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:46 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:46.579384 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652da076-63a1-499c-bd6b-cabc2d4258ae None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.590878 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652da076-63a1-499c-bd6b-cabc2d4258ae None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.616805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53817b66-fd55-44d5-bc3a-8f6ffa49ad6b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.618553 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-53817b66-fd55-44d5-bc3a-8f6ffa49ad6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.652663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f4fd0-90e3-45a4-ab50-779fe34673ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.653398 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4fd0-90e3-45a4-ab50-779fe34673ce admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.654882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4fd0-90e3-45a4-ab50-779fe34673ce admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.655183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f4fd0-90e3-45a4-ab50-779fe34673ce admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.655972 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f4fd0-90e3-45a4-ab50-779fe34673ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.657904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f4fd0-90e3-45a4-ab50-779fe34673ce admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.681521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1384/2770] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:46 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:46.682594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f4fd0-90e3-45a4-ab50-779fe34673ce admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.684477 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53817b66-fd55-44d5-bc3a-8f6ffa49ad6b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.689401 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.690453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.690680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.690961 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] PATH_INFO: `/v3/projects/d46b167f4490482092ff97e6f47c4e01` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.693052 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46b167f4490482092ff97e6f47c4e01)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.693209 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f4fd0-90e3-45a4-ab50-779fe34673ce admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.694976 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.697672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a57f-330d-478a-bf8d-b97d63dd2228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.698321 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a57f-330d-478a-bf8d-b97d63dd2228 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.698606 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a57f-330d-478a-bf8d-b97d63dd2228 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.698882 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24a57f-330d-478a-bf8d-b97d63dd2228 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.699643 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24a57f-330d-478a-bf8d-b97d63dd2228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.701212 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24a57f-330d-478a-bf8d-b97d63dd2228 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.712180 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1385/2771] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:46.716142 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a57f-330d-478a-bf8d-b97d63dd2228 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.726561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24a57f-330d-478a-bf8d-b97d63dd2228 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.731300 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755016e-08db-4cfb-8b48-fa5c6b091d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.732283 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755016e-08db-4cfb-8b48-fa5c6b091d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.732649 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755016e-08db-4cfb-8b48-fa5c6b091d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.732932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755016e-08db-4cfb-8b48-fa5c6b091d49 admin admin] PATH_INFO: `/v3/projects/9c6f93b2866847b5a782a8fe1faa6227/users/6dc8d97eece642a78eef0b0b9ab80e48/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.741210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46b167f4490482092ff97e6f47c4e01', 'request_id': 'req-0153c439-2aea-47a4-ad68-119f0bb44a6e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.747176 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46b167f4490482092ff97e6f47c4e01', 'request_id': 'req-0153c439-2aea-47a4-ad68-119f0bb44a6e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.747760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755016e-08db-4cfb-8b48-fa5c6b091d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6f93b2866847b5a782a8fe1faa6227, user_id=6dc8d97eece642a78eef0b0b9ab80e48, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.750421 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755016e-08db-4cfb-8b48-fa5c6b091d49 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.752600 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46b167f4490482092ff97e6f47c4e01', 'request_id': 'req-0153c439-2aea-47a4-ad68-119f0bb44a6e'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.764635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1386/2772] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:46 2022] PUT /identity/v3/projects/9c6f93b2866847b5a782a8fe1faa6227/users/6dc8d97eece642a78eef0b0b9ab80e48/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:46.768163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] The token cache is being invalidate because project d46b167f4490482092ff97e6f47c4e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:46.768462 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.768576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755016e-08db-4cfb-8b48-fa5c6b091d49 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.769133 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.770931 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-6755016e-08db-4cfb-8b48-fa5c6b091d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.771304 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1387/2773] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:46 2022] DELETE /identity/v3/projects/d46b167f4490482092ff97e6f47c4e01 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:46.774963 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.776353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.833279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755016e-08db-4cfb-8b48-fa5c6b091d49 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.837979 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5bd50-585b-4db7-a863-be3503cdd176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.838124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153c439-2aea-47a4-ad68-119f0bb44a6e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.838646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5bd50-585b-4db7-a863-be3503cdd176 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.838937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5bd50-585b-4db7-a863-be3503cdd176 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.839216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5bd50-585b-4db7-a863-be3503cdd176 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.839987 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5bd50-585b-4db7-a863-be3503cdd176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.841577 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5bd50-585b-4db7-a863-be3503cdd176 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.843029 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.843925 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.844207 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.844487 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] PATH_INFO: `/v3/users/1d9bbadc52c643269bbfe46367cc400c` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.845702 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9bbadc52c643269bbfe46367cc400c)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.847712 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.851312 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1387/2774] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:46.855255 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5bd50-585b-4db7-a863-be3503cdd176 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:46.865099 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5bd50-585b-4db7-a863-be3503cdd176 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:46.870029 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5e6c3-f371-4ef0-a0e2-20b7ce7c81f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:46.870893 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e6c3-f371-4ef0-a0e2-20b7ce7c81f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.871181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e6c3-f371-4ef0-a0e2-20b7ce7c81f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.871461 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5e6c3-f371-4ef0-a0e2-20b7ce7c81f4 admin admin] PATH_INFO: `/v3/projects/9c6f93b2866847b5a782a8fe1faa6227/users/6dc8d97eece642a78eef0b0b9ab80e48/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.873506 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5e6c3-f371-4ef0-a0e2-20b7ce7c81f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c6f93b2866847b5a782a8fe1faa6227, user_id=6dc8d97eece642a78eef0b0b9ab80e48, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:46.876420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5e6c3-f371-4ef0-a0e2-20b7ce7c81f4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:46.888069 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1388/2775] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:46 2022] PUT /identity/v3/projects/9c6f93b2866847b5a782a8fe1faa6227/users/6dc8d97eece642a78eef0b0b9ab80e48/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:46.898384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9bbadc52c643269bbfe46367cc400c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.900202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bea5f-2443-4aa3-8f07-ce6f1b872b24 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:46.900504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bea5f-2443-4aa3-8f07-ce6f1b872b24 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:46.900790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bea5f-2443-4aa3-8f07-ce6f1b872b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:46.905120 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9bbadc52c643269bbfe46367cc400c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.917341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9bbadc52c643269bbfe46367cc400c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.924416 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9bbadc52c643269bbfe46367cc400c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.925212 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9bbadc52c643269bbfe46367cc400c'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:46.927554 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ab4bea5f-2443-4aa3-8f07-ce6f1b872b24 None None] MFA Rules not processed for user `6dc8d97eece642a78eef0b0b9ab80e48`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:46.928799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ab4bea5f-2443-4aa3-8f07-ce6f1b872b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:46.931640 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1388/2776] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:46 2022] DELETE /identity/v3/users/1d9bbadc52c643269bbfe46367cc400c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:46.998753 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1389/2777] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:47.010242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.011692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:47.070798 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a473cf-30ad-4979-91eb-26842527c7f9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.075465 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388c1fb-afdc-445b-be74-73da7cf676ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.076247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388c1fb-afdc-445b-be74-73da7cf676ea service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.076601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388c1fb-afdc-445b-be74-73da7cf676ea service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.076944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388c1fb-afdc-445b-be74-73da7cf676ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.137946 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388c1fb-afdc-445b-be74-73da7cf676ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.139384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388c1fb-afdc-445b-be74-73da7cf676ea service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.149588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1389/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:47.202774 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bea5f-2443-4aa3-8f07-ce6f1b872b24 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.204278 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ab4bea5f-2443-4aa3-8f07-ce6f1b872b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:47.279277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bea5f-2443-4aa3-8f07-ce6f1b872b24 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.334757 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.335686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.335977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.336256 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] PATH_INFO: `/v3/projects/5d858fa7cbe14fb0b5764b2e7972009e` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.337477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d858fa7cbe14fb0b5764b2e7972009e)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.339574 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.387364 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d858fa7cbe14fb0b5764b2e7972009e', 'request_id': 'req-c23b8778-71ba-4d78-968a-e92080dd77df'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.393658 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d858fa7cbe14fb0b5764b2e7972009e', 'request_id': 'req-c23b8778-71ba-4d78-968a-e92080dd77df'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.400045 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d858fa7cbe14fb0b5764b2e7972009e', 'request_id': 'req-c23b8778-71ba-4d78-968a-e92080dd77df'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.410521 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] The token cache is being invalidate because project 5d858fa7cbe14fb0b5764b2e7972009e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:47.410924 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.411599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.413118 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1390/2779] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:47 2022] DELETE /identity/v3/projects/5d858fa7cbe14fb0b5764b2e7972009e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:47.418994 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4bea7-101f-45e7-a59c-9abde71e0238 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.419287 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4bea7-101f-45e7-a59c-9abde71e0238 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.419589 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4bea7-101f-45e7-a59c-9abde71e0238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.438374 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-acb4bea7-101f-45e7-a59c-9abde71e0238 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:47.439595 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-acb4bea7-101f-45e7-a59c-9abde71e0238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:47.451861 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.453180 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:47.498776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1390/2780] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:47.507632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad96066-12e7-4128-bc90-491e152b17c1 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.507923 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad96066-12e7-4128-bc90-491e152b17c1 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.508202 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad96066-12e7-4128-bc90-491e152b17c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.518628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b8778-71ba-4d78-968a-e92080dd77df admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.524107 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041754-536f-41af-850e-17ce7ddd6e8b tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc8d97eece642a78eef0b0b9ab80e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6f93b2866847b5a782a8fe1faa6227', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.524769 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041754-536f-41af-850e-17ce7ddd6e8b tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.525057 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041754-536f-41af-850e-17ce7ddd6e8b tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.525336 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7041754-536f-41af-850e-17ce7ddd6e8b tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.526075 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041754-536f-41af-850e-17ce7ddd6e8b tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:47.526382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041754-536f-41af-850e-17ce7ddd6e8b tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.526543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3ad96066-12e7-4128-bc90-491e152b17c1 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:47.527776 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3ad96066-12e7-4128-bc90-491e152b17c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:47.528135 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7041754-536f-41af-850e-17ce7ddd6e8b tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.536677 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1391/2781] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:47.540960 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad96066-12e7-4128-bc90-491e152b17c1 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.546648 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1391/2782] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:56:47.548205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041754-536f-41af-850e-17ce7ddd6e8b tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.550727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad96066-12e7-4128-bc90-491e152b17c1 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.555459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524abe-68e2-4bc9-ab3f-0237910da1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.556197 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524abe-68e2-4bc9-ab3f-0237910da1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.556484 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524abe-68e2-4bc9-ab3f-0237910da1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.556767 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d524abe-68e2-4bc9-ab3f-0237910da1d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.557513 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524abe-68e2-4bc9-ab3f-0237910da1d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:47.557823 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524abe-68e2-4bc9-ab3f-0237910da1d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.557965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7041754-536f-41af-850e-17ce7ddd6e8b tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.559424 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d524abe-68e2-4bc9-ab3f-0237910da1d4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.562533 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb62b4-02ec-4c09-99eb-26ed96fe60bb tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc8d97eece642a78eef0b0b9ab80e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6f93b2866847b5a782a8fe1faa6227', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.563175 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb62b4-02ec-4c09-99eb-26ed96fe60bb tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.563652 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb62b4-02ec-4c09-99eb-26ed96fe60bb tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.563940 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb62b4-02ec-4c09-99eb-26ed96fe60bb tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.564665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb62b4-02ec-4c09-99eb-26ed96fe60bb tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.566720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb62b4-02ec-4c09-99eb-26ed96fe60bb tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.571445 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1392/2783] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jan 27 16:56:47.575684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524abe-68e2-4bc9-ab3f-0237910da1d4 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.586496 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d524abe-68e2-4bc9-ab3f-0237910da1d4 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.591901 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9796f1c-3300-42fa-a686-005869224da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.592538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9796f1c-3300-42fa-a686-005869224da9 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.592824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9796f1c-3300-42fa-a686-005869224da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.593101 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9796f1c-3300-42fa-a686-005869224da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.593799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9796f1c-3300-42fa-a686-005869224da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.598739 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1392/2784] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:47 2022] POST /identity/v3/projects => generated 355 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:47.598903 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9796f1c-3300-42fa-a686-005869224da9 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.599857 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb62b4-02ec-4c09-99eb-26ed96fe60bb tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.624425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1393/2785] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:47 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:47.625379 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9796f1c-3300-42fa-a686-005869224da9 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.660497 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb62b4-02ec-4c09-99eb-26ed96fe60bb tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.688829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9796f1c-3300-42fa-a686-005869224da9 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.693824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62bdd-6f01-4adf-bf6d-3acd55057546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.694489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62bdd-6f01-4adf-bf6d-3acd55057546 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.694772 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62bdd-6f01-4adf-bf6d-3acd55057546 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.695051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f62bdd-6f01-4adf-bf6d-3acd55057546 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.695786 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f62bdd-6f01-4adf-bf6d-3acd55057546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.697710 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f62bdd-6f01-4adf-bf6d-3acd55057546 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.716906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cc845-ac8b-499a-9022-5090b84ce395 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc8d97eece642a78eef0b0b9ab80e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6f93b2866847b5a782a8fe1faa6227', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.717493 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cc845-ac8b-499a-9022-5090b84ce395 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.717782 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cc845-ac8b-499a-9022-5090b84ce395 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.718067 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cc845-ac8b-499a-9022-5090b84ce395 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] PATH_INFO: `/v3/domains` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.718797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cc845-ac8b-499a-9022-5090b84ce395 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=90785) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:47.719112 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cc845-ac8b-499a-9022-5090b84ce395 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.720808 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cc845-ac8b-499a-9022-5090b84ce395 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.721987 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1394/2786] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:47 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:47.726875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62bdd-6f01-4adf-bf6d-3acd55057546 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.738660 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1393/2787] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:56:47.743427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f62bdd-6f01-4adf-bf6d-3acd55057546 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.749621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d390517-6642-4383-a4bc-4adcbff6f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.750302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d390517-6642-4383-a4bc-4adcbff6f988 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.750577 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d390517-6642-4383-a4bc-4adcbff6f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.750852 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d390517-6642-4383-a4bc-4adcbff6f988 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.751669 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d390517-6642-4383-a4bc-4adcbff6f988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.753588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d390517-6642-4383-a4bc-4adcbff6f988 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.765243 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1395/2788] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:47.769080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cc845-ac8b-499a-9022-5090b84ce395 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.779126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d390517-6642-4383-a4bc-4adcbff6f988 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.780671 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cc845-ac8b-499a-9022-5090b84ce395 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.786008 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68219d-107d-4899-905e-f4ce13214a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.786673 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68219d-107d-4899-905e-f4ce13214a19 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.786958 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68219d-107d-4899-905e-f4ce13214a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.787327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68219d-107d-4899-905e-f4ce13214a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.788576 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68219d-107d-4899-905e-f4ce13214a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.789684 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68219d-107d-4899-905e-f4ce13214a19 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.792596 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d390517-6642-4383-a4bc-4adcbff6f988 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.797419 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6dc8d97eece642a78eef0b0b9ab80e48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6f93b2866847b5a782a8fe1faa6227', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.798278 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.798564 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.798843 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] PATH_INFO: `/v3/projects/9adefca137a34d2dbda8691e89a18c56` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.800072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9adefca137a34d2dbda8691e89a18c56)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.801779 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1394/2789] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:47.805367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.806671 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68219d-107d-4899-905e-f4ce13214a19 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.817242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68219d-107d-4899-905e-f4ce13214a19 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:47.822291 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bbd11-682b-4d47-ba45-73ecfb6f576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:47.823340 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbd11-682b-4d47-ba45-73ecfb6f576a admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.823953 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbd11-682b-4d47-ba45-73ecfb6f576a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.824238 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bbd11-682b-4d47-ba45-73ecfb6f576a admin admin] PATH_INFO: `/v3/projects/207209f7d61e43d5b78a502b2deb0bb7/users/98ca10b1d1224eeaa458ec6a2b32c608/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.841580 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbd11-682b-4d47-ba45-73ecfb6f576a admin admin] RBAC: Authorizing `identity:create_grant(project_id=207209f7d61e43d5b78a502b2deb0bb7, user_id=98ca10b1d1224eeaa458ec6a2b32c608, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:47.844893 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bbd11-682b-4d47-ba45-73ecfb6f576a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:47.855488 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9adefca137a34d2dbda8691e89a18c56', 'request_id': 'req-b397b94f-d3b2-4531-92d3-d21fdf884097'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.862152 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9adefca137a34d2dbda8691e89a18c56', 'request_id': 'req-b397b94f-d3b2-4531-92d3-d21fdf884097'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.864520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1395/2790] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:47 2022] PUT /identity/v3/projects/207209f7d61e43d5b78a502b2deb0bb7/users/98ca10b1d1224eeaa458ec6a2b32c608/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:47.868254 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9adefca137a34d2dbda8691e89a18c56', 'request_id': 'req-b397b94f-d3b2-4531-92d3-d21fdf884097'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.874593 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63453e-0cc6-41b5-a205-e9a2b4bd2380 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:47.874911 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63453e-0cc6-41b5-a205-e9a2b4bd2380 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:47.875196 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63453e-0cc6-41b5-a205-e9a2b4bd2380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:47.884100 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] The token cache is being invalidate because project 9adefca137a34d2dbda8691e89a18c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:47.885040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.885777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:47.888055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1396/2791] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:47 2022] DELETE /identity/v3/projects/9adefca137a34d2dbda8691e89a18c56 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:47.907504 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-8f63453e-0cc6-41b5-a205-e9a2b4bd2380 None None] MFA Rules not processed for user `98ca10b1d1224eeaa458ec6a2b32c608`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:47.908783 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8f63453e-0cc6-41b5-a205-e9a2b4bd2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:47.980602 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1396/2792] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:47.985092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:47.986774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:48.072894 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397b94f-d3b2-4531-92d3-d21fdf884097 tempest-VolumeQuotaClassesTest-1894746611 tempest-VolumeQuotaClassesTest-1894746611-project-admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.102019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63453e-0cc6-41b5-a205-e9a2b4bd2380 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.103464 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8f63453e-0cc6-41b5-a205-e9a2b4bd2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:48.133058 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58662b-90cb-46a2-8bce-502226236509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.133724 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58662b-90cb-46a2-8bce-502226236509 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.134005 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58662b-90cb-46a2-8bce-502226236509 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.134530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58662b-90cb-46a2-8bce-502226236509 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.135247 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58662b-90cb-46a2-8bce-502226236509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.137187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58662b-90cb-46a2-8bce-502226236509 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.171411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f63453e-0cc6-41b5-a205-e9a2b4bd2380 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.171936 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1397/2793] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:47 2022] POST /identity/v3/projects => generated 377 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:48.175861 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58662b-90cb-46a2-8bce-502226236509 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.229280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.230157 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.230445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.230782 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] PATH_INFO: `/v3/users/a348659d417a496dbb749bd2e9680cb6` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.231961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a348659d417a496dbb749bd2e9680cb6)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.233906 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.235887 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58662b-90cb-46a2-8bce-502226236509 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.240863 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3a43b-15b4-44f5-86b8-016cd97ef2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.241530 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a43b-15b4-44f5-86b8-016cd97ef2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.241809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a43b-15b4-44f5-86b8-016cd97ef2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.242083 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3a43b-15b4-44f5-86b8-016cd97ef2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.242782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3a43b-15b4-44f5-86b8-016cd97ef2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.244719 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f3a43b-15b4-44f5-86b8-016cd97ef2c7 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.267601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1398/2794] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:48 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:48.271586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3a43b-15b4-44f5-86b8-016cd97ef2c7 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.280872 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a348659d417a496dbb749bd2e9680cb6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:48.281926 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f3a43b-15b4-44f5-86b8-016cd97ef2c7 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.286860 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fb279-16b1-4fdf-80de-c0533d717eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.287510 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fb279-16b1-4fdf-80de-c0533d717eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.287828 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fb279-16b1-4fdf-80de-c0533d717eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.288107 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fb279-16b1-4fdf-80de-c0533d717eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.288839 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fb279-16b1-4fdf-80de-c0533d717eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.289139 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a348659d417a496dbb749bd2e9680cb6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:48.289814 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a348659d417a496dbb749bd2e9680cb6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:48.290415 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fb279-16b1-4fdf-80de-c0533d717eb1 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.300233 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1399/2795] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:48.301965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a348659d417a496dbb749bd2e9680cb6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:48.306398 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fb279-16b1-4fdf-80de-c0533d717eb1 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.310026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-1dd1b070-58dc-4e3a-830f-e18853837f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a348659d417a496dbb749bd2e9680cb6'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:48.317301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fb279-16b1-4fdf-80de-c0533d717eb1 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.317949 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1397/2796] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:48 2022] DELETE /identity/v3/users/a348659d417a496dbb749bd2e9680cb6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:48.322231 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d92e-4e5a-4b1c-9f05-e9072816cce9 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.322524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d92e-4e5a-4b1c-9f05-e9072816cce9 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.322802 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7d92e-4e5a-4b1c-9f05-e9072816cce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.343406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-5ec7d92e-4e5a-4b1c-9f05-e9072816cce9 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:48.344627 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5ec7d92e-4e5a-4b1c-9f05-e9072816cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:48.373014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae6fd2-327c-44d1-b8bc-ae102b8eb2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.373687 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae6fd2-327c-44d1-b8bc-ae102b8eb2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.373975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae6fd2-327c-44d1-b8bc-ae102b8eb2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.374258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae6fd2-327c-44d1-b8bc-ae102b8eb2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.375025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae6fd2-327c-44d1-b8bc-ae102b8eb2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.376653 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae6fd2-327c-44d1-b8bc-ae102b8eb2f5 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.387602 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1400/2797] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:48.391680 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae6fd2-327c-44d1-b8bc-ae102b8eb2f5 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.393364 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2dae6fd2-327c-44d1-b8bc-ae102b8eb2f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:48.402275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1398/2798] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:48.406284 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae6fd2-327c-44d1-b8bc-ae102b8eb2f5 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.411196 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce058e3-48fd-4f97-80a9-c3347738d22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.412124 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce058e3-48fd-4f97-80a9-c3347738d22d admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.412258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7d92e-4e5a-4b1c-9f05-e9072816cce9 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.412538 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce058e3-48fd-4f97-80a9-c3347738d22d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.412826 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce058e3-48fd-4f97-80a9-c3347738d22d admin admin] PATH_INFO: `/v3/projects/b13616cb15b5454589da8ff3240101a3/users/c7840420b48a49fba80eb995bc452197/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.413612 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-5ec7d92e-4e5a-4b1c-9f05-e9072816cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:48.429592 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce058e3-48fd-4f97-80a9-c3347738d22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b13616cb15b5454589da8ff3240101a3, user_id=c7840420b48a49fba80eb995bc452197, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.432276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce058e3-48fd-4f97-80a9-c3347738d22d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.450168 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1401/2799] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:48 2022] PUT /identity/v3/projects/b13616cb15b5454589da8ff3240101a3/users/c7840420b48a49fba80eb995bc452197/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:48.459508 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee6378-89f2-4b39-9d64-d95134ddf8cc None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.459848 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee6378-89f2-4b39-9d64-d95134ddf8cc None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.460126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee6378-89f2-4b39-9d64-d95134ddf8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.474215 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7d92e-4e5a-4b1c-9f05-e9072816cce9 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.486126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-fbee6378-89f2-4b39-9d64-d95134ddf8cc None None] MFA Rules not processed for user `c7840420b48a49fba80eb995bc452197`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:48.487274 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-fbee6378-89f2-4b39-9d64-d95134ddf8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:48.525100 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ba240-4f57-47b2-add9-fb88f5f43db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.525745 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ba240-4f57-47b2-add9-fb88f5f43db5 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.526027 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ba240-4f57-47b2-add9-fb88f5f43db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.526303 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ba240-4f57-47b2-add9-fb88f5f43db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.550692 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1402/2800] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:48.555019 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee6378-89f2-4b39-9d64-d95134ddf8cc None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.588718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ba240-4f57-47b2-add9-fb88f5f43db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.590812 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ba240-4f57-47b2-add9-fb88f5f43db5 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.601451 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1399/2801] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:56:48.617497 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee6378-89f2-4b39-9d64-d95134ddf8cc None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.622069 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0576d0-f6e1-4d81-9d0d-89f3ab093a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.622726 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0576d0-f6e1-4d81-9d0d-89f3ab093a04 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.623013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0576d0-f6e1-4d81-9d0d-89f3ab093a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.623331 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0576d0-f6e1-4d81-9d0d-89f3ab093a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.624072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0576d0-f6e1-4d81-9d0d-89f3ab093a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.625957 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0576d0-f6e1-4d81-9d0d-89f3ab093a04 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.651910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1403/2802] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:48 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:48.656085 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ba240-4f57-47b2-add9-fb88f5f43db5 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.665898 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ba240-4f57-47b2-add9-fb88f5f43db5 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.720893 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8dfb8-6399-4307-84d3-d97aeb635733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.721563 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8dfb8-6399-4307-84d3-d97aeb635733 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.721887 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8dfb8-6399-4307-84d3-d97aeb635733 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.722298 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8dfb8-6399-4307-84d3-d97aeb635733 admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.723500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8dfb8-6399-4307-84d3-d97aeb635733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.725442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8dfb8-6399-4307-84d3-d97aeb635733 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.747589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1400/2803] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:48 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:48.751208 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0576d0-f6e1-4d81-9d0d-89f3ab093a04 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.763277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0576d0-f6e1-4d81-9d0d-89f3ab093a04 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.768062 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b75940-7494-4288-b1e5-0aae7c05809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.768969 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b75940-7494-4288-b1e5-0aae7c05809f admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.769320 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b75940-7494-4288-b1e5-0aae7c05809f admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.769809 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b75940-7494-4288-b1e5-0aae7c05809f admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.770678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b75940-7494-4288-b1e5-0aae7c05809f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.772367 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b75940-7494-4288-b1e5-0aae7c05809f admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.782973 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1404/2804] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:48.788161 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8dfb8-6399-4307-84d3-d97aeb635733 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.797959 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8dfb8-6399-4307-84d3-d97aeb635733 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.802811 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d071a-1669-40bb-8eca-453c78fc4079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.803770 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d071a-1669-40bb-8eca-453c78fc4079 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.804055 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d071a-1669-40bb-8eca-453c78fc4079 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.804333 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d071a-1669-40bb-8eca-453c78fc4079 admin admin] PATH_INFO: `/v3/projects/6bb801d635d147dbaa0fe5cef3cc5a09/users/2af2de16a42e4fe7a33a1c3e168259c5/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.819666 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d071a-1669-40bb-8eca-453c78fc4079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb801d635d147dbaa0fe5cef3cc5a09, user_id=2af2de16a42e4fe7a33a1c3e168259c5, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.822423 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d071a-1669-40bb-8eca-453c78fc4079 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.836376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1401/2805] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:48 2022] PUT /identity/v3/projects/6bb801d635d147dbaa0fe5cef3cc5a09/users/2af2de16a42e4fe7a33a1c3e168259c5/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:48.840174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b75940-7494-4288-b1e5-0aae7c05809f admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.850993 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b75940-7494-4288-b1e5-0aae7c05809f admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.867551 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d071a-1669-40bb-8eca-453c78fc4079 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.869344 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-497d071a-1669-40bb-8eca-453c78fc4079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:48.913478 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ba580-7508-41ea-8387-ec29bfcc0b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.914157 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ba580-7508-41ea-8387-ec29bfcc0b62 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.914441 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ba580-7508-41ea-8387-ec29bfcc0b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.914720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ba580-7508-41ea-8387-ec29bfcc0b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.915506 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ba580-7508-41ea-8387-ec29bfcc0b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.917249 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ba580-7508-41ea-8387-ec29bfcc0b62 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.927129 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1405/2806] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:48.931160 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ba580-7508-41ea-8387-ec29bfcc0b62 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:48.937716 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d071a-1669-40bb-8eca-453c78fc4079 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.940483 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ba580-7508-41ea-8387-ec29bfcc0b62 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:48.943299 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.944242 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.944718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.945002 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] PATH_INFO: `/v3/projects/8312debdd46c40138ce82ef860efd571` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.946250 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb659de-374a-4a9d-b0ef-9b5b4330d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:48.946718 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8312debdd46c40138ce82ef860efd571)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.947227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb659de-374a-4a9d-b0ef-9b5b4330d6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.947504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb659de-374a-4a9d-b0ef-9b5b4330d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.947847 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb659de-374a-4a9d-b0ef-9b5b4330d6b4 admin admin] PATH_INFO: `/v3/projects/6bb801d635d147dbaa0fe5cef3cc5a09/users/2af2de16a42e4fe7a33a1c3e168259c5/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.949190 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.950213 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb659de-374a-4a9d-b0ef-9b5b4330d6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bb801d635d147dbaa0fe5cef3cc5a09, user_id=2af2de16a42e4fe7a33a1c3e168259c5, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:48.953391 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb659de-374a-4a9d-b0ef-9b5b4330d6b4 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:48.964750 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1406/2807] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:48 2022] PUT /identity/v3/projects/6bb801d635d147dbaa0fe5cef3cc5a09/users/2af2de16a42e4fe7a33a1c3e168259c5/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:48.975714 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b940aa-ccf3-4d58-a3aa-8ecc1abb479b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:48.976014 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b940aa-ccf3-4d58-a3aa-8ecc1abb479b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:48.976297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b940aa-ccf3-4d58-a3aa-8ecc1abb479b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:48.999663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8312debdd46c40138ce82ef860efd571', 'request_id': 'req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.002294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e0b940aa-ccf3-4d58-a3aa-8ecc1abb479b None None] MFA Rules not processed for user `2af2de16a42e4fe7a33a1c3e168259c5`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:49.004021 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e0b940aa-ccf3-4d58-a3aa-8ecc1abb479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:49.007799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8312debdd46c40138ce82ef860efd571', 'request_id': 'req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.014248 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8312debdd46c40138ce82ef860efd571', 'request_id': 'req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.025512 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] The token cache is being invalidate because project 8312debdd46c40138ce82ef860efd571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:49.025799 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.026446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.028171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1402/2808] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:48 2022] DELETE /identity/v3/projects/8312debdd46c40138ce82ef860efd571 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:49.031962 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:49.033297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:49.072586 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1407/2809] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:49.083255 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b940aa-ccf3-4d58-a3aa-8ecc1abb479b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:49.084715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e0b940aa-ccf3-4d58-a3aa-8ecc1abb479b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:49.096406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f712d-c04b-470d-ab8b-57ed19ce23f8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:49.101757 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:49.102630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.102917 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.103199 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] PATH_INFO: `/v3/users/6dc8d97eece642a78eef0b0b9ab80e48` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.104457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc8d97eece642a78eef0b0b9ab80e48)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:49.106381 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:49.139672 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b940aa-ccf3-4d58-a3aa-8ecc1abb479b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:49.143468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae4f07-5b3e-456a-82f3-a56354962c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:49.145482 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae4f07-5b3e-456a-82f3-a56354962c78 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.145805 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae4f07-5b3e-456a-82f3-a56354962c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.146136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae4f07-5b3e-456a-82f3-a56354962c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.148322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-61ae4f07-5b3e-456a-82f3-a56354962c78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:49.151452 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc8d97eece642a78eef0b0b9ab80e48'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.158552 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc8d97eece642a78eef0b0b9ab80e48'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.159320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc8d97eece642a78eef0b0b9ab80e48'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.170599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc8d97eece642a78eef0b0b9ab80e48'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.178570 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc8d97eece642a78eef0b0b9ab80e48'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.184636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1403/2810] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:49 2022] DELETE /identity/v3/users/6dc8d97eece642a78eef0b0b9ab80e48 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:49.207560 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae4f07-5b3e-456a-82f3-a56354962c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:49.209198 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae4f07-5b3e-456a-82f3-a56354962c78 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:49.217975 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1408/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:56:49.458239 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:49.460133 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:49.541750 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31193c-0371-4ce7-8e53-3dc4a1679cd7 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:49.551665 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:49.552537 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.552825 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.553105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] PATH_INFO: `/v3/projects/9c6f93b2866847b5a782a8fe1faa6227` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.554332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c6f93b2866847b5a782a8fe1faa6227)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:49.556749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:49.604676 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c6f93b2866847b5a782a8fe1faa6227', 'request_id': 'req-b0a75c91-80f3-4421-b1b0-c323a38c75ec'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.611510 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c6f93b2866847b5a782a8fe1faa6227', 'request_id': 'req-b0a75c91-80f3-4421-b1b0-c323a38c75ec'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.618210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c6f93b2866847b5a782a8fe1faa6227', 'request_id': 'req-b0a75c91-80f3-4421-b1b0-c323a38c75ec'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.628402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] The token cache is being invalidate because project 9c6f93b2866847b5a782a8fe1faa6227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:49.628681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.629371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-b0a75c91-80f3-4421-b1b0-c323a38c75ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:49.630933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1404/2812] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:49 2022] DELETE /identity/v3/projects/9c6f93b2866847b5a782a8fe1faa6227 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:49.636877 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8c164-2275-4019-926e-103b25635927 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.637201 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8c164-2275-4019-926e-103b25635927 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.637485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8c164-2275-4019-926e-103b25635927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.654998 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-94b8c164-2275-4019-926e-103b25635927 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:49.656235 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-94b8c164-2275-4019-926e-103b25635927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:49.714285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1409/2813] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:49.722081 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d60e-418e-4b65-9d5d-3410b3da9ecd None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.722921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d60e-418e-4b65-9d5d-3410b3da9ecd None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.723205 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98d60e-418e-4b65-9d5d-3410b3da9ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.742884 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-ee98d60e-418e-4b65-9d5d-3410b3da9ecd None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:49.744131 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ee98d60e-418e-4b65-9d5d-3410b3da9ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:49.752036 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1405/2814] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:49.756294 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8c164-2275-4019-926e-103b25635927 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:49.766690 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8c164-2275-4019-926e-103b25635927 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:49.772288 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28075081-e359-4566-8556-4cb27e2ac673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:49.772957 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28075081-e359-4566-8556-4cb27e2ac673 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.773242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28075081-e359-4566-8556-4cb27e2ac673 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.773521 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28075081-e359-4566-8556-4cb27e2ac673 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.774257 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28075081-e359-4566-8556-4cb27e2ac673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:49.774561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28075081-e359-4566-8556-4cb27e2ac673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:49.776450 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28075081-e359-4566-8556-4cb27e2ac673 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:49.788958 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1410/2815] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:56:49.793845 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98d60e-418e-4b65-9d5d-3410b3da9ecd None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:49.803095 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98d60e-418e-4b65-9d5d-3410b3da9ecd None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:49.807760 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415410e2-1e9c-4b0c-a414-62eb2aa81ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:49.808413 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415410e2-1e9c-4b0c-a414-62eb2aa81ddd admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.808696 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415410e2-1e9c-4b0c-a414-62eb2aa81ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.808973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415410e2-1e9c-4b0c-a414-62eb2aa81ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.809672 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415410e2-1e9c-4b0c-a414-62eb2aa81ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:49.811560 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415410e2-1e9c-4b0c-a414-62eb2aa81ddd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:49.836098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1406/2816] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:49 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:49.840165 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28075081-e359-4566-8556-4cb27e2ac673 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:49.850619 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28075081-e359-4566-8556-4cb27e2ac673 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:49.904405 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f860cf7-b555-4faa-be36-48c250f0740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:49.905065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f860cf7-b555-4faa-be36-48c250f0740e admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.905350 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f860cf7-b555-4faa-be36-48c250f0740e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.905628 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f860cf7-b555-4faa-be36-48c250f0740e admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.906335 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f860cf7-b555-4faa-be36-48c250f0740e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:49.908289 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f860cf7-b555-4faa-be36-48c250f0740e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:49.927686 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1411/2817] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:49 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:49.931831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415410e2-1e9c-4b0c-a414-62eb2aa81ddd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:49.941644 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415410e2-1e9c-4b0c-a414-62eb2aa81ddd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:49.947053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1fae-8359-408b-af98-5c71d4d2d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:49.947784 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1fae-8359-408b-af98-5c71d4d2d4bd admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.948124 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1fae-8359-408b-af98-5c71d4d2d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.948408 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f1fae-8359-408b-af98-5c71d4d2d4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.949252 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f1fae-8359-408b-af98-5c71d4d2d4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:49.950994 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f1fae-8359-408b-af98-5c71d4d2d4bd admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:49.961827 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1407/2818] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:49.965713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f860cf7-b555-4faa-be36-48c250f0740e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:49.976011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f860cf7-b555-4faa-be36-48c250f0740e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:49.980516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd67959-3c8c-4c9e-9d2f-2f9eedf1d944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:49.981163 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd67959-3c8c-4c9e-9d2f-2f9eedf1d944 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:49.981446 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd67959-3c8c-4c9e-9d2f-2f9eedf1d944 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:49.981722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd67959-3c8c-4c9e-9d2f-2f9eedf1d944 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:49.982454 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd67959-3c8c-4c9e-9d2f-2f9eedf1d944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:49.984066 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd67959-3c8c-4c9e-9d2f-2f9eedf1d944 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:49.993557 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1412/2819] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:49.997501 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1fae-8359-408b-af98-5c71d4d2d4bd admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:50.007853 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f1fae-8359-408b-af98-5c71d4d2d4bd admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:50.012938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa6efe-2869-4859-b5bd-10fcbd9d5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:50.013807 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa6efe-2869-4859-b5bd-10fcbd9d5c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:50.014089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa6efe-2869-4859-b5bd-10fcbd9d5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:50.014386 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa6efe-2869-4859-b5bd-10fcbd9d5c70 admin admin] PATH_INFO: `/v3/projects/5c7e7ca3910d467cb4e6e5678fb3aa01/users/51a016fb93964afab5668c0ebc5cbe6b/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:50.030694 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa6efe-2869-4859-b5bd-10fcbd9d5c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7e7ca3910d467cb4e6e5678fb3aa01, user_id=51a016fb93964afab5668c0ebc5cbe6b, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:50.033382 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa6efe-2869-4859-b5bd-10fcbd9d5c70 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:50.047483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1408/2820] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:49 2022] PUT /identity/v3/projects/5c7e7ca3910d467cb4e6e5678fb3aa01/users/51a016fb93964afab5668c0ebc5cbe6b/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:50.052883 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb47534-673a-4ba9-a517-4223d71f9cbf None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:50.053178 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb47534-673a-4ba9-a517-4223d71f9cbf None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:50.053463 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb47534-673a-4ba9-a517-4223d71f9cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:50.071502 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-7bb47534-673a-4ba9-a517-4223d71f9cbf None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:50.072734 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7bb47534-673a-4ba9-a517-4223d71f9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:50.128328 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1413/2821] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:50.138301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa6efe-2869-4859-b5bd-10fcbd9d5c70 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:50.140059 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cdaa6efe-2869-4859-b5bd-10fcbd9d5c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:50.195056 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa6efe-2869-4859-b5bd-10fcbd9d5c70 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:50.198650 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df7b22-7562-4358-a79b-9977e618cf8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:50.199277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df7b22-7562-4358-a79b-9977e618cf8e service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:50.199559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df7b22-7562-4358-a79b-9977e618cf8e service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:50.199865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df7b22-7562-4358-a79b-9977e618cf8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:50.208880 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df7b22-7562-4358-a79b-9977e618cf8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:50.210290 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df7b22-7562-4358-a79b-9977e618cf8e service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:50.219277 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1409/2822] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:50.716836 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb47534-673a-4ba9-a517-4223d71f9cbf None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:50.718226 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-7bb47534-673a-4ba9-a517-4223d71f9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:50.774580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb47534-673a-4ba9-a517-4223d71f9cbf None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:50.778696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4b902-8768-4077-a7f6-d77c83b2d917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:50.779351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4b902-8768-4077-a7f6-d77c83b2d917 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:50.779665 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4b902-8768-4077-a7f6-d77c83b2d917 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:50.779948 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4b902-8768-4077-a7f6-d77c83b2d917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:50.781775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2fd4b902-8768-4077-a7f6-d77c83b2d917 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:50.839159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26427b-8396-4251-946e-8fd9ba8a6a1a None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:50.839446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26427b-8396-4251-946e-8fd9ba8a6a1a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:50.839789 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26427b-8396-4251-946e-8fd9ba8a6a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:50.846953 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4b902-8768-4077-a7f6-d77c83b2d917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:50.848072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4b902-8768-4077-a7f6-d77c83b2d917 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:50.857698 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1414/2823] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:50.867352 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-3b26427b-8396-4251-946e-8fd9ba8a6a1a None None] MFA Rules not processed for user `51a016fb93964afab5668c0ebc5cbe6b`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:50.868653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-3b26427b-8396-4251-946e-8fd9ba8a6a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:50.939767 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1410/2824] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:50.944945 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4b902-8768-4077-a7f6-d77c83b2d917 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:50.957742 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4b902-8768-4077-a7f6-d77c83b2d917 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:50.963561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0fa98-73c7-4732-a13b-0b45ba668624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:50.964314 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fa98-73c7-4732-a13b-0b45ba668624 admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:50.964684 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fa98-73c7-4732-a13b-0b45ba668624 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:50.965041 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0fa98-73c7-4732-a13b-0b45ba668624 admin admin] PATH_INFO: `/v3/projects` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:50.965872 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0fa98-73c7-4732-a13b-0b45ba668624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:50.967812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0fa98-73c7-4732-a13b-0b45ba668624 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:50.996136 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1415/2825] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:50 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:51.000301 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26427b-8396-4251-946e-8fd9ba8a6a1a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:51.013182 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26427b-8396-4251-946e-8fd9ba8a6a1a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:51.078505 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434845-4bd4-4c14-a628-67830ce1246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:51.079203 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434845-4bd4-4c14-a628-67830ce1246d admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:51.079489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434845-4bd4-4c14-a628-67830ce1246d admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:51.079873 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434845-4bd4-4c14-a628-67830ce1246d admin admin] PATH_INFO: `/v3/users` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:51.080589 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed434845-4bd4-4c14-a628-67830ce1246d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:51.082903 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed434845-4bd4-4c14-a628-67830ce1246d admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:51.105163 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1411/2826] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:50 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:51.108910 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0fa98-73c7-4732-a13b-0b45ba668624 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:51.120955 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0fa98-73c7-4732-a13b-0b45ba668624 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:51.126537 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c750ef-11be-450e-bfa9-b0ec4a710e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:51.127550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c750ef-11be-450e-bfa9-b0ec4a710e33 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:51.127774 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c750ef-11be-450e-bfa9-b0ec4a710e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:51.128106 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c750ef-11be-450e-bfa9-b0ec4a710e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:51.130085 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c750ef-11be-450e-bfa9-b0ec4a710e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:51.131939 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c750ef-11be-450e-bfa9-b0ec4a710e33 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:51.147302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1416/2827] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:56:51.148524 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434845-4bd4-4c14-a628-67830ce1246d admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:51.158488 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434845-4bd4-4c14-a628-67830ce1246d admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:51.164316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36511c4-dfed-41cd-bb07-e30be2fa98c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:51.165204 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36511c4-dfed-41cd-bb07-e30be2fa98c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:51.165489 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36511c4-dfed-41cd-bb07-e30be2fa98c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:51.165792 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36511c4-dfed-41cd-bb07-e30be2fa98c8 admin admin] PATH_INFO: `/v3/projects/9a688ab9c1c945e8bc2689fd953854a0/users/e851a9d939d3437e878e6bf2e997ade6/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:51.181536 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36511c4-dfed-41cd-bb07-e30be2fa98c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a688ab9c1c945e8bc2689fd953854a0, user_id=e851a9d939d3437e878e6bf2e997ade6, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:51.184227 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36511c4-dfed-41cd-bb07-e30be2fa98c8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:51.197183 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1412/2828] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:51 2022] PUT /identity/v3/projects/9a688ab9c1c945e8bc2689fd953854a0/users/e851a9d939d3437e878e6bf2e997ade6/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:51.201626 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c750ef-11be-450e-bfa9-b0ec4a710e33 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:51.212468 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c750ef-11be-450e-bfa9-b0ec4a710e33 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:51.400150 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f40bc7-9c8e-4c1b-868f-cb22e4c84ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:51.400818 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f40bc7-9c8e-4c1b-868f-cb22e4c84ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:51.401104 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f40bc7-9c8e-4c1b-868f-cb22e4c84ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:51.401384 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f40bc7-9c8e-4c1b-868f-cb22e4c84ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:51.402121 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f40bc7-9c8e-4c1b-868f-cb22e4c84ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:51.403735 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f40bc7-9c8e-4c1b-868f-cb22e4c84ec6 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:51.411459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36511c4-dfed-41cd-bb07-e30be2fa98c8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:51.414224 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1417/2829] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:51.417997 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f40bc7-9c8e-4c1b-868f-cb22e4c84ec6 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:51.428162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f40bc7-9c8e-4c1b-868f-cb22e4c84ec6 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:51.432789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb3091-443a-4507-8c70-0db519d4cd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:51.433674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3091-443a-4507-8c70-0db519d4cd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:51.433953 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3091-443a-4507-8c70-0db519d4cd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:51.434227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb3091-443a-4507-8c70-0db519d4cd46 admin admin] PATH_INFO: `/v3/projects/9a688ab9c1c945e8bc2689fd953854a0/users/e851a9d939d3437e878e6bf2e997ade6/roles/b635b195d45a4fdeaa8c60f1e5b04127` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:51.436229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb3091-443a-4507-8c70-0db519d4cd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a688ab9c1c945e8bc2689fd953854a0, user_id=e851a9d939d3437e878e6bf2e997ade6, role_id=b635b195d45a4fdeaa8c60f1e5b04127)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:51.438843 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb3091-443a-4507-8c70-0db519d4cd46 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:51.450017 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1418/2830] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:51 2022] PUT /identity/v3/projects/9a688ab9c1c945e8bc2689fd953854a0/users/e851a9d939d3437e878e6bf2e997ade6/roles/b635b195d45a4fdeaa8c60f1e5b04127 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:51.466202 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36511c4-dfed-41cd-bb07-e30be2fa98c8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:51.518031 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01325ee-a22a-47e5-a13f-23886703051f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:51.519113 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01325ee-a22a-47e5-a13f-23886703051f service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:51.520302 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01325ee-a22a-47e5-a13f-23886703051f service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:51.520584 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01325ee-a22a-47e5-a13f-23886703051f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:51.522463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c01325ee-a22a-47e5-a13f-23886703051f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:51.593150 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01325ee-a22a-47e5-a13f-23886703051f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:51.594594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01325ee-a22a-47e5-a13f-23886703051f service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:51.604181 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1413/2831] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:52.079725 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f8eb-f066-4b72-bf11-a66c0a2dc5bd None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:52.080229 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f8eb-f066-4b72-bf11-a66c0a2dc5bd None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:52.080356 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295f8eb-f066-4b72-bf11-a66c0a2dc5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:52.106704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3295f8eb-f066-4b72-bf11-a66c0a2dc5bd None None] MFA Rules not processed for user `e851a9d939d3437e878e6bf2e997ade6`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:52.107868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3295f8eb-f066-4b72-bf11-a66c0a2dc5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:52.174055 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1419/2832] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:52.184639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01325ee-a22a-47e5-a13f-23886703051f service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:52.193781 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01325ee-a22a-47e5-a13f-23886703051f service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:52.197676 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f5833-2d93-4b5a-ade0-7098228c71cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:52.198313 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f5833-2d93-4b5a-ade0-7098228c71cb service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:52.198594 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f5833-2d93-4b5a-ade0-7098228c71cb service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:52.198866 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f5833-2d93-4b5a-ade0-7098228c71cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:52.254864 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f5833-2d93-4b5a-ade0-7098228c71cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:52.256330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f5833-2d93-4b5a-ade0-7098228c71cb service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:52.265636 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1414/2833] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:52.970516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295f8eb-f066-4b72-bf11-a66c0a2dc5bd None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:52.970516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3295f8eb-f066-4b72-bf11-a66c0a2dc5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:53.034421 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295f8eb-f066-4b72-bf11-a66c0a2dc5bd None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:53.040205 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5bbcf690d144ab99438b3f65b5e100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:53.040854 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:53.041138 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:53.041417 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:53.043224 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:53.054588 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:53.056281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:53.066793 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1420/2834] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:53.598097 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f5833-2d93-4b5a-ade0-7098228c71cb service cinder] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:53.606500 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f5833-2d93-4b5a-ade0-7098228c71cb service cinder] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:53.610065 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173e33-c296-4942-b1f3-ea344295a049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:53.610705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173e33-c296-4942-b1f3-ea344295a049 service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:53.610988 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173e33-c296-4942-b1f3-ea344295a049 service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:53.611267 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173e33-c296-4942-b1f3-ea344295a049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:53.620018 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05173e33-c296-4942-b1f3-ea344295a049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:53.621436 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05173e33-c296-4942-b1f3-ea344295a049 service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:53.630790 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1415/2835] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:55.396748 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:55.398122 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:55.459917 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37237752-3e94-4cf8-b33a-45b3f4de232f service placement] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:55.464423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:55.465277 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:55.465561 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:55.465837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] PATH_INFO: `/v3/users/98ca10b1d1224eeaa458ec6a2b32c608` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:55.467023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ca10b1d1224eeaa458ec6a2b32c608)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:55.468954 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:55.513696 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ca10b1d1224eeaa458ec6a2b32c608'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:55.521186 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ca10b1d1224eeaa458ec6a2b32c608'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:55.532365 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ca10b1d1224eeaa458ec6a2b32c608'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:55.539397 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ca10b1d1224eeaa458ec6a2b32c608'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:55.540040 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ca10b1d1224eeaa458ec6a2b32c608'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:55.545813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1421/2836] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:55 2022] DELETE /identity/v3/users/98ca10b1d1224eeaa458ec6a2b32c608 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:55.550841 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760996-3829-4a05-8463-137b2807a530 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:55.551280 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760996-3829-4a05-8463-137b2807a530 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:55.551411 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7760996-3829-4a05-8463-137b2807a530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:55.569373 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-f7760996-3829-4a05-8463-137b2807a530 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:55.570562 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f7760996-3829-4a05-8463-137b2807a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:55.626902 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1416/2837] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:55.637638 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:55.639011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:55.694543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8fcdc-3e05-4537-9810-113bca9010fa admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:55.698144 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb9fbc-f8bc-46e4-9289-50f99cfb7bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:55.698787 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb9fbc-f8bc-46e4-9289-50f99cfb7bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:55.699072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb9fbc-f8bc-46e4-9289-50f99cfb7bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:55.699351 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb9fbc-f8bc-46e4-9289-50f99cfb7bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:55.708656 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb9fbc-f8bc-46e4-9289-50f99cfb7bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:55.710073 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb9fbc-f8bc-46e4-9289-50f99cfb7bd2 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:55.719210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1422/2838] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:56:55.977565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760996-3829-4a05-8463-137b2807a530 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:55.979006 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-f7760996-3829-4a05-8463-137b2807a530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:55.993565 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7760996-3829-4a05-8463-137b2807a530 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:55.998366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:55.999371 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:55.999532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:55.999836 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] PATH_INFO: `/v3/projects/207209f7d61e43d5b78a502b2deb0bb7` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:56.001720 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207209f7d61e43d5b78a502b2deb0bb7)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:56.004773 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:56.049459 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207209f7d61e43d5b78a502b2deb0bb7', 'request_id': 'req-38085733-e98d-4323-a576-9a46fda07215'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.057062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207209f7d61e43d5b78a502b2deb0bb7', 'request_id': 'req-38085733-e98d-4323-a576-9a46fda07215'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.063171 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207209f7d61e43d5b78a502b2deb0bb7', 'request_id': 'req-38085733-e98d-4323-a576-9a46fda07215'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.073422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] The token cache is being invalidate because project 207209f7d61e43d5b78a502b2deb0bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:56.073707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.074316 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.075844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1417/2839] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:55 2022] DELETE /identity/v3/projects/207209f7d61e43d5b78a502b2deb0bb7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:56.079837 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb9fbc-f8bc-46e4-9289-50f99cfb7bd2 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:56.089427 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb9fbc-f8bc-46e4-9289-50f99cfb7bd2 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:56.146090 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:56.146956 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:56.147241 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:56.147520 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] PATH_INFO: `/v3/users/c7840420b48a49fba80eb995bc452197` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:56.148757 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7840420b48a49fba80eb995bc452197)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:56.150664 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:56.197802 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7840420b48a49fba80eb995bc452197'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.204551 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7840420b48a49fba80eb995bc452197'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.216833 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7840420b48a49fba80eb995bc452197'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.224012 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7840420b48a49fba80eb995bc452197'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.224812 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7840420b48a49fba80eb995bc452197'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.230988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1423/2840] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:56 2022] DELETE /identity/v3/users/c7840420b48a49fba80eb995bc452197 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:56.504837 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:56.506376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:56.520630 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38085733-e98d-4323-a576-9a46fda07215 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:56.576941 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:56.577805 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:56.578089 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:56.578376 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] PATH_INFO: `/v3/projects/b13616cb15b5454589da8ff3240101a3` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:56.579559 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b13616cb15b5454589da8ff3240101a3)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:56.581529 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:56.624809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b13616cb15b5454589da8ff3240101a3', 'request_id': 'req-66d71612-a1ef-4139-82e3-9010a8171d9c'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.632681 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b13616cb15b5454589da8ff3240101a3', 'request_id': 'req-66d71612-a1ef-4139-82e3-9010a8171d9c'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.638927 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b13616cb15b5454589da8ff3240101a3', 'request_id': 'req-66d71612-a1ef-4139-82e3-9010a8171d9c'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.648703 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] The token cache is being invalidate because project b13616cb15b5454589da8ff3240101a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:56.648996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.649628 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.651149 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1418/2841] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:56 2022] DELETE /identity/v3/projects/b13616cb15b5454589da8ff3240101a3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:56.655094 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:56.656568 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:56.668815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a6ea8-f33a-40cc-8277-33067d4f6d41 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:56.723358 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:56.724182 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:56.724472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:56.724754 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] PATH_INFO: `/v3/users/2af2de16a42e4fe7a33a1c3e168259c5` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:56.725949 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af2de16a42e4fe7a33a1c3e168259c5)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:56.728190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:56.772811 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af2de16a42e4fe7a33a1c3e168259c5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.780296 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af2de16a42e4fe7a33a1c3e168259c5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.792118 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af2de16a42e4fe7a33a1c3e168259c5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.799777 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af2de16a42e4fe7a33a1c3e168259c5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.800543 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-fed9e820-6743-49c8-9242-d6b4952aad28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af2de16a42e4fe7a33a1c3e168259c5'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:56.806154 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1424/2842] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:56:56 2022] DELETE /identity/v3/users/2af2de16a42e4fe7a33a1c3e168259c5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:57.080801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:57.082977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:57.096710 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d71612-a1ef-4139-82e3-9010a8171d9c admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:57.156664 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:57.157532 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.157822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.158106 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] PATH_INFO: `/v3/projects/6bb801d635d147dbaa0fe5cef3cc5a09` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.159361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bb801d635d147dbaa0fe5cef3cc5a09)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:57.161564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:57.208663 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bb801d635d147dbaa0fe5cef3cc5a09', 'request_id': 'req-05649538-c1c8-4682-8928-cb6e408a28f8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:57.217026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bb801d635d147dbaa0fe5cef3cc5a09', 'request_id': 'req-05649538-c1c8-4682-8928-cb6e408a28f8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:57.223984 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bb801d635d147dbaa0fe5cef3cc5a09', 'request_id': 'req-05649538-c1c8-4682-8928-cb6e408a28f8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:57.234800 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] The token cache is being invalidate because project 6bb801d635d147dbaa0fe5cef3cc5a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:56:57.235094 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:57.235791 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-05649538-c1c8-4682-8928-cb6e408a28f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:56:57.237338 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1419/2843] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:56:57 2022] DELETE /identity/v3/projects/6bb801d635d147dbaa0fe5cef3cc5a09 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:56:57.244916 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace23ca-268a-400c-87c8-6c6f78df249b None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.245245 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace23ca-268a-400c-87c8-6c6f78df249b None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.245555 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace23ca-268a-400c-87c8-6c6f78df249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.266200 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-3ace23ca-268a-400c-87c8-6c6f78df249b None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:57.267330 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-3ace23ca-268a-400c-87c8-6c6f78df249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:57.331092 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1425/2844] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:57.338900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faca97-be10-48d6-9fa2-d1d420326333 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.339187 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faca97-be10-48d6-9fa2-d1d420326333 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.339494 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faca97-be10-48d6-9fa2-d1d420326333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.358970 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-e5faca97-be10-48d6-9fa2-d1d420326333 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:57.360928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-e5faca97-be10-48d6-9fa2-d1d420326333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:57.372910 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1420/2845] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jan 27 16:56:57.377048 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace23ca-268a-400c-87c8-6c6f78df249b None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:57.387838 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace23ca-268a-400c-87c8-6c6f78df249b None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:57.392674 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28d4c4-e58b-4fcd-b461-a9e86bb21444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:57.393396 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d4c4-e58b-4fcd-b461-a9e86bb21444 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.393713 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d4c4-e58b-4fcd-b461-a9e86bb21444 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.394226 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d4c4-e58b-4fcd-b461-a9e86bb21444 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.395322 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28d4c4-e58b-4fcd-b461-a9e86bb21444 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:56:57.395679 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28d4c4-e58b-4fcd-b461-a9e86bb21444 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:57.397286 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28d4c4-e58b-4fcd-b461-a9e86bb21444 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:57.409231 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1426/2846] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:56:57.413618 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faca97-be10-48d6-9fa2-d1d420326333 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:57.422831 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faca97-be10-48d6-9fa2-d1d420326333 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:57.428699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba59dff-ae72-415f-b369-30720d3e42a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:57.429366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59dff-ae72-415f-b369-30720d3e42a4 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.429646 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59dff-ae72-415f-b369-30720d3e42a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.429921 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba59dff-ae72-415f-b369-30720d3e42a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.430631 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba59dff-ae72-415f-b369-30720d3e42a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:57.433088 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba59dff-ae72-415f-b369-30720d3e42a4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:57.462732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1421/2847] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:56:57 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:56:57.463891 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28d4c4-e58b-4fcd-b461-a9e86bb21444 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:57.474001 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28d4c4-e58b-4fcd-b461-a9e86bb21444 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:57.534409 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10457639-b306-49d0-abf5-8ac066ba49bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:57.535088 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10457639-b306-49d0-abf5-8ac066ba49bc admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.535400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10457639-b306-49d0-abf5-8ac066ba49bc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.535720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10457639-b306-49d0-abf5-8ac066ba49bc admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.536472 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10457639-b306-49d0-abf5-8ac066ba49bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:57.538504 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10457639-b306-49d0-abf5-8ac066ba49bc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:57.564907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1427/2848] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:56:57 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jan 27 16:56:57.570858 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba59dff-ae72-415f-b369-30720d3e42a4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:57.581883 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba59dff-ae72-415f-b369-30720d3e42a4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:57.587728 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda7fe1-b71b-4e09-8c33-b41739420077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:57.588355 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda7fe1-b71b-4e09-8c33-b41739420077 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.588639 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda7fe1-b71b-4e09-8c33-b41739420077 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.588922 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda7fe1-b71b-4e09-8c33-b41739420077 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.589659 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda7fe1-b71b-4e09-8c33-b41739420077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:57.598801 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda7fe1-b71b-4e09-8c33-b41739420077 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:57.611192 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1422/2849] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:57.615528 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10457639-b306-49d0-abf5-8ac066ba49bc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:57.629815 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10457639-b306-49d0-abf5-8ac066ba49bc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:57.638486 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03544ef8-6979-4630-9d5b-d4fc6a40fb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:57.639171 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544ef8-6979-4630-9d5b-d4fc6a40fb32 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.639453 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544ef8-6979-4630-9d5b-d4fc6a40fb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.639765 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03544ef8-6979-4630-9d5b-d4fc6a40fb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.640516 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03544ef8-6979-4630-9d5b-d4fc6a40fb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:57.642089 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03544ef8-6979-4630-9d5b-d4fc6a40fb32 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:57.656642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1428/2850] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jan 27 16:56:57.657896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda7fe1-b71b-4e09-8c33-b41739420077 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:57.669270 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda7fe1-b71b-4e09-8c33-b41739420077 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:57.674037 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076efc2b-4428-44de-8ced-6118e50c6aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:57.675625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076efc2b-4428-44de-8ced-6118e50c6aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.675930 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076efc2b-4428-44de-8ced-6118e50c6aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.676210 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076efc2b-4428-44de-8ced-6118e50c6aa8 admin admin] PATH_INFO: `/v3/projects/7ae6a28544f74a1d81ef1424fe2364f0/users/290bccf48e6c43f18aa608f6970dbfbf/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.692339 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076efc2b-4428-44de-8ced-6118e50c6aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae6a28544f74a1d81ef1424fe2364f0, user_id=290bccf48e6c43f18aa608f6970dbfbf, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:57.695287 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076efc2b-4428-44de-8ced-6118e50c6aa8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:57.708761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1423/2851] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:56:57 2022] PUT /identity/v3/projects/7ae6a28544f74a1d81ef1424fe2364f0/users/290bccf48e6c43f18aa608f6970dbfbf/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jan 27 16:56:57.720281 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff54f6-2bd8-412d-9757-adf60f7d4870 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.720576 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff54f6-2bd8-412d-9757-adf60f7d4870 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.720880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff54f6-2bd8-412d-9757-adf60f7d4870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.747383 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-dfff54f6-2bd8-412d-9757-adf60f7d4870 None None] MFA Rules not processed for user `290bccf48e6c43f18aa608f6970dbfbf`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:56:57.748801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-dfff54f6-2bd8-412d-9757-adf60f7d4870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:57.811210 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1429/2852] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:56:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:56:57.823235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076efc2b-4428-44de-8ced-6118e50c6aa8 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:56:57.824938 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-076efc2b-4428-44de-8ced-6118e50c6aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:56:57.879697 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076efc2b-4428-44de-8ced-6118e50c6aa8 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:56:57.883443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd49a1-0e07-4f2f-a240-48b12439b191 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '295fe8f61f87423bb49471e2f0085690', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:56:57.884483 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd49a1-0e07-4f2f-a240-48b12439b191 service glance] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:56:57.884771 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd49a1-0e07-4f2f-a240-48b12439b191 service glance] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:56:57.885054 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd49a1-0e07-4f2f-a240-48b12439b191 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:56:57.893893 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd49a1-0e07-4f2f-a240-48b12439b191 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:56:57.895678 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd49a1-0e07-4f2f-a240-48b12439b191 service glance] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:56:57.904677 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1424/2853] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:56:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:57:06.376851 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff54f6-2bd8-412d-9757-adf60f7d4870 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:06.378875 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-dfff54f6-2bd8-412d-9757-adf60f7d4870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:06.442824 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff54f6-2bd8-412d-9757-adf60f7d4870 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:06.447190 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:06.448097 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:06.448380 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:06.448685 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] PATH_INFO: `/v3/users/51a016fb93964afab5668c0ebc5cbe6b` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:06.449870 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=51a016fb93964afab5668c0ebc5cbe6b)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:06.451803 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:06.497162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51a016fb93964afab5668c0ebc5cbe6b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.505341 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51a016fb93964afab5668c0ebc5cbe6b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.517112 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51a016fb93964afab5668c0ebc5cbe6b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.526423 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51a016fb93964afab5668c0ebc5cbe6b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.527432 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51a016fb93964afab5668c0ebc5cbe6b'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.534658 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1430/2854] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:57:06 2022] DELETE /identity/v3/users/51a016fb93964afab5668c0ebc5cbe6b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:57:06.707102 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd49a1-0e07-4f2f-a240-48b12439b191 service glance] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:06.718540 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd49a1-0e07-4f2f-a240-48b12439b191 service glance] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:06.775705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:06.776561 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:06.776844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:06.777120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] PATH_INFO: `/v3/projects/5c7e7ca3910d467cb4e6e5678fb3aa01` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:06.778337 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7e7ca3910d467cb4e6e5678fb3aa01)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:06.780273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:06.827273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7e7ca3910d467cb4e6e5678fb3aa01', 'request_id': 'req-095cc4e0-44f8-405d-a745-b1deb5bed857'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.838465 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7e7ca3910d467cb4e6e5678fb3aa01', 'request_id': 'req-095cc4e0-44f8-405d-a745-b1deb5bed857'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.841446 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7e7ca3910d467cb4e6e5678fb3aa01', 'request_id': 'req-095cc4e0-44f8-405d-a745-b1deb5bed857'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.852047 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] The token cache is being invalidate because project 5c7e7ca3910d467cb4e6e5678fb3aa01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:57:06.852342 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.852996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.854528 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1425/2855] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:57:06 2022] DELETE /identity/v3/projects/5c7e7ca3910d467cb4e6e5678fb3aa01 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:57:06.858573 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:06.860016 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:06.873608 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab9199-a6a9-40af-b010-670cdb3bec2b admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:06.929550 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:06.930433 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:06.930715 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:06.930990 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] PATH_INFO: `/v3/users/e851a9d939d3437e878e6bf2e997ade6` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:06.932216 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e851a9d939d3437e878e6bf2e997ade6)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:06.934135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:06.979142 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e851a9d939d3437e878e6bf2e997ade6'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.985801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e851a9d939d3437e878e6bf2e997ade6'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:06.996873 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e851a9d939d3437e878e6bf2e997ade6'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:07.004269 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e851a9d939d3437e878e6bf2e997ade6'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:07.004913 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-c1792e12-d305-4411-82f7-e972494f2948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e851a9d939d3437e878e6bf2e997ade6'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:07.010918 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1431/2856] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:57:06 2022] DELETE /identity/v3/users/e851a9d939d3437e878e6bf2e997ade6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:57:07.185934 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:07.187414 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:07.203162 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cc4e0-44f8-405d-a745-b1deb5bed857 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:07.261229 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:07.262121 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.262406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.262687 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] PATH_INFO: `/v3/projects/9a688ab9c1c945e8bc2689fd953854a0` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.264030 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a688ab9c1c945e8bc2689fd953854a0)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:07.266520 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:07.313402 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a688ab9c1c945e8bc2689fd953854a0', 'request_id': 'req-5311215f-19c3-4bcb-9850-158a8f3006db'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:07.322073 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a688ab9c1c945e8bc2689fd953854a0', 'request_id': 'req-5311215f-19c3-4bcb-9850-158a8f3006db'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:07.328749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a688ab9c1c945e8bc2689fd953854a0', 'request_id': 'req-5311215f-19c3-4bcb-9850-158a8f3006db'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:07.338919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] The token cache is being invalidate because project 9a688ab9c1c945e8bc2689fd953854a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:57:07.339213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:07.339865 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-5311215f-19c3-4bcb-9850-158a8f3006db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:07.341397 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1426/2857] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:57:07 2022] DELETE /identity/v3/projects/9a688ab9c1c945e8bc2689fd953854a0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:57:07.347110 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcc554-90ea-4165-94d0-984dbaf3e466 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.347400 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcc554-90ea-4165-94d0-984dbaf3e466 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.347701 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcc554-90ea-4165-94d0-984dbaf3e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.367452 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-e8fcc554-90ea-4165-94d0-984dbaf3e466 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:57:07.368720 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-e8fcc554-90ea-4165-94d0-984dbaf3e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:07.429775 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1432/2858] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:57:07.437625 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb11d-57eb-4e8a-86a8-798d1643bedf None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.437919 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb11d-57eb-4e8a-86a8-798d1643bedf None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.438200 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cb11d-57eb-4e8a-86a8-798d1643bedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.456443 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-d41cb11d-57eb-4e8a-86a8-798d1643bedf None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:57:07.457626 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-d41cb11d-57eb-4e8a-86a8-798d1643bedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:07.465629 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1427/2859] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:57:07.469778 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcc554-90ea-4165-94d0-984dbaf3e466 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:07.480155 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcc554-90ea-4165-94d0-984dbaf3e466 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:07.484601 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0fe17-50ec-4a4c-95c6-ce6907ef1998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:07.485242 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0fe17-50ec-4a4c-95c6-ce6907ef1998 admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.485524 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0fe17-50ec-4a4c-95c6-ce6907ef1998 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.485799 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0fe17-50ec-4a4c-95c6-ce6907ef1998 admin admin] PATH_INFO: `/v3/domains` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.486526 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0fe17-50ec-4a4c-95c6-ce6907ef1998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=90784) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jan 27 16:57:07.486829 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0fe17-50ec-4a4c-95c6-ce6907ef1998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:07.489385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0fe17-50ec-4a4c-95c6-ce6907ef1998 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:07.500988 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1433/2860] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jan 27 16:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jan 27 16:57:07.505844 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb11d-57eb-4e8a-86a8-798d1643bedf None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:07.515347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cb11d-57eb-4e8a-86a8-798d1643bedf None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:07.519900 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472d16-0e45-4089-a449-c91ae752df92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:07.520543 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472d16-0e45-4089-a449-c91ae752df92 admin admin] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.520824 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472d16-0e45-4089-a449-c91ae752df92 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.521098 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46472d16-0e45-4089-a449-c91ae752df92 admin admin] PATH_INFO: `/v3/projects` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.521797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46472d16-0e45-4089-a449-c91ae752df92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:07.523702 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46472d16-0e45-4089-a449-c91ae752df92 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:07.550049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1428/2861] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jan 27 16:57:07 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:57:07.554189 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0fe17-50ec-4a4c-95c6-ce6907ef1998 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:07.563816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0fe17-50ec-4a4c-95c6-ce6907ef1998 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:07.617517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a8864-cdec-422e-ae5a-58dbeaffd24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:07.618187 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a8864-cdec-422e-ae5a-58dbeaffd24e admin admin] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.618470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a8864-cdec-422e-ae5a-58dbeaffd24e admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.618745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a8864-cdec-422e-ae5a-58dbeaffd24e admin admin] PATH_INFO: `/v3/users` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.619459 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a8864-cdec-422e-ae5a-58dbeaffd24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:07.621405 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a8864-cdec-422e-ae5a-58dbeaffd24e admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:07.640732 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1434/2862] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jan 27 16:57:07 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jan 27 16:57:07.644977 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472d16-0e45-4089-a449-c91ae752df92 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:07.655281 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46472d16-0e45-4089-a449-c91ae752df92 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:07.660572 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53dbb4-95bc-49d1-8a66-7055062e12b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:07.661233 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53dbb4-95bc-49d1-8a66-7055062e12b0 admin admin] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.661517 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53dbb4-95bc-49d1-8a66-7055062e12b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.661793 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53dbb4-95bc-49d1-8a66-7055062e12b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.662527 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53dbb4-95bc-49d1-8a66-7055062e12b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:07.664147 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53dbb4-95bc-49d1-8a66-7055062e12b0 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:07.674279 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1429/2863] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:57:07.678915 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a8864-cdec-422e-ae5a-58dbeaffd24e admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:07.688556 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a8864-cdec-422e-ae5a-58dbeaffd24e admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:07.693797 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e09425-37fc-4783-b7ef-0212381a2b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:07.694470 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09425-37fc-4783-b7ef-0212381a2b5c admin admin] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.694745 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09425-37fc-4783-b7ef-0212381a2b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.695023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e09425-37fc-4783-b7ef-0212381a2b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.695792 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09425-37fc-4783-b7ef-0212381a2b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:07.697385 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e09425-37fc-4783-b7ef-0212381a2b5c admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:07.708011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1435/2864] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jan 27 16:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jan 27 16:57:07.711992 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53dbb4-95bc-49d1-8a66-7055062e12b0 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:07.722611 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53dbb4-95bc-49d1-8a66-7055062e12b0 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:07.728074 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cefca-c94c-4ca8-9bc6-49a2c493bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:07.728951 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cefca-c94c-4ca8-9bc6-49a2c493bac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.729235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cefca-c94c-4ca8-9bc6-49a2c493bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.729515 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cefca-c94c-4ca8-9bc6-49a2c493bac4 admin admin] PATH_INFO: `/v3/projects/767737a162014e4cb7e0f9ff1c13cfa5/users/41d5539ae7884106bfebc460c9acb0f2/roles/77071b28cf624ed1b3bd0dd30d0910b2` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.744343 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cefca-c94c-4ca8-9bc6-49a2c493bac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767737a162014e4cb7e0f9ff1c13cfa5, user_id=41d5539ae7884106bfebc460c9acb0f2, role_id=77071b28cf624ed1b3bd0dd30d0910b2)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:07.746985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cefca-c94c-4ca8-9bc6-49a2c493bac4 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:07.760463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1430/2865] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jan 27 16:57:07 2022] PUT /identity/v3/projects/767737a162014e4cb7e0f9ff1c13cfa5/users/41d5539ae7884106bfebc460c9acb0f2/roles/77071b28cf624ed1b3bd0dd30d0910b2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:57:07.772061 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440883c-0f81-46b7-aa5a-ff92022ffd24 None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.772353 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440883c-0f81-46b7-aa5a-ff92022ffd24 None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.772634 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f440883c-0f81-46b7-aa5a-ff92022ffd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.798968 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-f440883c-0f81-46b7-aa5a-ff92022ffd24 None None] MFA Rules not processed for user `41d5539ae7884106bfebc460c9acb0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:57:07.800868 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-f440883c-0f81-46b7-aa5a-ff92022ffd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:07.860075 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1436/2866] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:57:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:57:07.870406 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cefca-c94c-4ca8-9bc6-49a2c493bac4 admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:07.872105 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-014cefca-c94c-4ca8-9bc6-49a2c493bac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:07.927867 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cefca-c94c-4ca8-9bc6-49a2c493bac4 admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:07.931516 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8fdef-1e74-40aa-9c31-37bceaed00ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:07.932221 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8fdef-1e74-40aa-9c31-37bceaed00ec service cinder] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:07.932502 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8fdef-1e74-40aa-9c31-37bceaed00ec service cinder] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:07.932778 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8fdef-1e74-40aa-9c31-37bceaed00ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:07.942705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8fdef-1e74-40aa-9c31-37bceaed00ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:07.944271 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8fdef-1e74-40aa-9c31-37bceaed00ec service cinder] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:07.954188 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1431/2867] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:57:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:57:07.975096 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440883c-0f81-46b7-aa5a-ff92022ffd24 None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:08.034747 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f440883c-0f81-46b7-aa5a-ff92022ffd24 None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:08.039302 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:08.040209 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:08.040515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:08.040789 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] PATH_INFO: `/v3/users/41d5539ae7884106bfebc460c9acb0f2` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:08.042000 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d5539ae7884106bfebc460c9acb0f2)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:08.044246 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:08.087820 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d5539ae7884106bfebc460c9acb0f2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.094180 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d5539ae7884106bfebc460c9acb0f2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.105522 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d5539ae7884106bfebc460c9acb0f2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.113718 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d5539ae7884106bfebc460c9acb0f2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.114333 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d5539ae7884106bfebc460c9acb0f2'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.121185 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1437/2868] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:57:07 2022] DELETE /identity/v3/users/41d5539ae7884106bfebc460c9acb0f2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:57:08.125700 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66cbb8-4046-44bf-949f-7855253feccc None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:08.126001 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66cbb8-4046-44bf-949f-7855253feccc None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:08.126305 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66cbb8-4046-44bf-949f-7855253feccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:08.144539 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-cf66cbb8-4046-44bf-949f-7855253feccc None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:57:08.145809 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cf66cbb8-4046-44bf-949f-7855253feccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:08.204458 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1432/2869] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:57:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:57:08.214580 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:08.215981 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:08.270621 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f77179-1ba7-490a-a196-afc5d08b18fc admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:08.274126 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5dfd0-87c6-4bc7-91a5-375a03934223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:08.274756 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5dfd0-87c6-4bc7-91a5-375a03934223 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:08.275036 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5dfd0-87c6-4bc7-91a5-375a03934223 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:08.275313 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c5dfd0-87c6-4bc7-91a5-375a03934223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:08.284515 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5dfd0-87c6-4bc7-91a5-375a03934223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:08.286011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c5dfd0-87c6-4bc7-91a5-375a03934223 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:08.294813 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1438/2870] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:57:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:57:08.547891 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66cbb8-4046-44bf-949f-7855253feccc None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:08.549686 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-cf66cbb8-4046-44bf-949f-7855253feccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:08.561375 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66cbb8-4046-44bf-949f-7855253feccc None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:08.565961 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:08.566832 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:08.567111 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:08.567392 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] PATH_INFO: `/v3/projects/767737a162014e4cb7e0f9ff1c13cfa5` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:08.568806 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767737a162014e4cb7e0f9ff1c13cfa5)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:08.571136 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:08.620749 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767737a162014e4cb7e0f9ff1c13cfa5', 'request_id': 'req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.627326 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767737a162014e4cb7e0f9ff1c13cfa5', 'request_id': 'req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.633420 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767737a162014e4cb7e0f9ff1c13cfa5', 'request_id': 'req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.643798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] The token cache is being invalidate because project 767737a162014e4cb7e0f9ff1c13cfa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:57:08.643798 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.644759 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-c2c63aa6-30dc-447e-89a0-f82ac0e984d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:08.646282 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1433/2871] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:57:08 2022] DELETE /identity/v3/projects/767737a162014e4cb7e0f9ff1c13cfa5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:57:28.782971 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5dfd0-87c6-4bc7-91a5-375a03934223 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:28.784488 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-37c5dfd0-87c6-4bc7-91a5-375a03934223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:28.796840 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c5dfd0-87c6-4bc7-91a5-375a03934223 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:28.853011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:28.853880 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:28.854174 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:28.854451 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] PATH_INFO: `/v3/users/290bccf48e6c43f18aa608f6970dbfbf` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:28.855667 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=290bccf48e6c43f18aa608f6970dbfbf)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:28.857566 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:28.903642 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '290bccf48e6c43f18aa608f6970dbfbf'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:28.910406 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '290bccf48e6c43f18aa608f6970dbfbf'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:28.921579 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '290bccf48e6c43f18aa608f6970dbfbf'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:28.929512 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '290bccf48e6c43f18aa608f6970dbfbf'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:28.930139 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '290bccf48e6c43f18aa608f6970dbfbf'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:28.935937 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1439/2872] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 16:57:28 2022] DELETE /identity/v3/users/290bccf48e6c43f18aa608f6970dbfbf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:57:28.940980 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490ab91-4cb1-4467-8edf-8cdc56fdfbc4 None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:28.941457 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490ab91-4cb1-4467-8edf-8cdc56fdfbc4 None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:28.941564 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490ab91-4cb1-4467-8edf-8cdc56fdfbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:28.958732 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-c490ab91-4cb1-4467-8edf-8cdc56fdfbc4 None None] MFA Rules not processed for user `8b36880779e54979b4c28d8db11f3446`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:57:28.959965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c490ab91-4cb1-4467-8edf-8cdc56fdfbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:29.015053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1434/2873] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:57:29.024591 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:29.026025 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:29.080761 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f60995-eb5d-4994-b0b2-4e36caf0f669 admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:29.084425 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f0e1b-1004-4198-bb68-345e334077c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:29.085065 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f0e1b-1004-4198-bb68-345e334077c9 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:29.085352 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f0e1b-1004-4198-bb68-345e334077c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:29.085632 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f0e1b-1004-4198-bb68-345e334077c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:29.094297 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f0e1b-1004-4198-bb68-345e334077c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:29.095795 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f0e1b-1004-4198-bb68-345e334077c9 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:29.104986 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1440/2874] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:57:29.359422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490ab91-4cb1-4467-8edf-8cdc56fdfbc4 None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:57:29.360858 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-c490ab91-4cb1-4467-8edf-8cdc56fdfbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:29.374026 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490ab91-4cb1-4467-8edf-8cdc56fdfbc4 None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:57:29.379275 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:57:29.380159 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:29.380442 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:29.380721 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] PATH_INFO: `/v3/projects/7ae6a28544f74a1d81ef1424fe2364f0` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:29.381925 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae6a28544f74a1d81ef1424fe2364f0)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:57:29.384123 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:57:29.428624 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae6a28544f74a1d81ef1424fe2364f0', 'request_id': 'req-03c4a9aa-0e4c-48bc-9235-c1f581265dad'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:29.435463 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae6a28544f74a1d81ef1424fe2364f0', 'request_id': 'req-03c4a9aa-0e4c-48bc-9235-c1f581265dad'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:29.442053 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae6a28544f74a1d81ef1424fe2364f0', 'request_id': 'req-03c4a9aa-0e4c-48bc-9235-c1f581265dad'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:29.451822 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] The token cache is being invalidate because project 7ae6a28544f74a1d81ef1424fe2364f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90785) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 16:57:29.452109 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:29.452719 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-03c4a9aa-0e4c-48bc-9235-c1f581265dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 16:57:29.454211 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1435/2875] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 16:57:29 2022] DELETE /identity/v3/projects/7ae6a28544f74a1d81ef1424fe2364f0 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 16:57:32.289722 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be3c3-97f0-4f68-98b5-bbaebc3cb88f None None] REQUEST_METHOD: `POST` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:57:32.290300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be3c3-97f0-4f68-98b5-bbaebc3cb88f None None] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:57:32.290300 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972be3c3-97f0-4f68-98b5-bbaebc3cb88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:57:32.308158 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.auth.core [None req-972be3c3-97f0-4f68-98b5-bbaebc3cb88f None None] MFA Rules not processed for user `6bf586d36da74c29ab1a188bb6da8603`. Rule list: `[]` (Enabled: `True`). {{(pid=90784) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:57:32.309349 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-972be3c3-97f0-4f68-98b5-bbaebc3cb88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:57:32.361181 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1441/2876] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:57:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:59:23.150599 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb111a-0e79-453b-a7f1-8e4a305dae1a None None] REQUEST_METHOD: `POST` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:59:23.151120 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb111a-0e79-453b-a7f1-8e4a305dae1a None None] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:59:23.151235 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb111a-0e79-453b-a7f1-8e4a305dae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:59:23.169080 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.auth.core [None req-4beb111a-0e79-453b-a7f1-8e4a305dae1a None None] MFA Rules not processed for user `6bf586d36da74c29ab1a188bb6da8603`. Rule list: `[]` (Enabled: `True`). {{(pid=90785) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jan 27 16:59:23.170273 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4beb111a-0e79-453b-a7f1-8e4a305dae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:23.177635 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1436/2877] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jan 27 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jan 27 16:59:23.211648 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972be3c3-97f0-4f68-98b5-bbaebc3cb88f None None] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:59:23.213018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-972be3c3-97f0-4f68-98b5-bbaebc3cb88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:23.267051 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972be3c3-97f0-4f68-98b5-bbaebc3cb88f None None] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:59:23.271053 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a62aede1113047fc80983b85ae0cbfe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:59:23.271727 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:59:23.272013 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:59:23.272288 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:59:23.274006 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:23.340651 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:59:23.342023 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:59:23.352637 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1442/2878] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:59:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:59:23.629582 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb111a-0e79-453b-a7f1-8e4a305dae1a None None] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:59:23.630973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-4beb111a-0e79-453b-a7f1-8e4a305dae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:23.685928 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb111a-0e79-453b-a7f1-8e4a305dae1a None None] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:59:23.689509 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe0d2-164e-413c-9add-9aa18c8f081b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:59:23.690332 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe0d2-164e-413c-9add-9aa18c8f081b service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:59:23.690617 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe0d2-164e-413c-9add-9aa18c8f081b service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:59:23.690896 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfe0d2-164e-413c-9add-9aa18c8f081b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:59:23.692670 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-b6bfe0d2-164e-413c-9add-9aa18c8f081b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:23.701849 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfe0d2-164e-413c-9add-9aa18c8f081b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:59:23.703258 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfe0d2-164e-413c-9add-9aa18c8f081b service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:59:23.711224 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1437/2879] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:59:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:59:24.136123 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:59:24.137549 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:24.145116 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe0d2-164e-413c-9add-9aa18c8f081b service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:59:24.153572 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfe0d2-164e-413c-9add-9aa18c8f081b service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:59:24.157534 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:59:24.158173 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:59:24.159022 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:59:24.159588 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:59:24.161399 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:24.175989 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:59:24.177424 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:59:24.188445 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1438/2880] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:59:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:59:24.205068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488231e-9151-4adc-b552-23fe9c6874e6 service cinder] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:59:24.210011 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5bbcf690d144ab99438b3f65b5e100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:59:24.210661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:59:24.210944 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:59:24.211227 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:59:24.213004 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:24.225373 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:59:24.226951 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:59:24.238495 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1443/2881] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:59:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:59:25.804863 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:59:25.806458 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:25.818545 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f28bd8-9c68-4333-ad6c-98ce5fea2421 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:59:25.822284 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:59:25.822932 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:59:25.823213 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:59:25.823487 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:59:25.825310 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:25.836354 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:59:25.837797 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:59:25.846330 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1439/2882] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:59:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:59:26.451907 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:59:26.453827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:26.478068 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394a187-32b1-4675-90b8-110c1b911a29 service placement] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:59:26.484444 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf747-46e2-4cae-a5bf-bc717a4c800f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:59:26.485103 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf747-46e2-4cae-a5bf-bc717a4c800f service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:59:26.485437 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf747-46e2-4cae-a5bf-bc717a4c800f service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:59:26.485661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf747-46e2-4cae-a5bf-bc717a4c800f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:59:26.488678 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-daecf747-46e2-4cae-a5bf-bc717a4c800f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:26.511689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf747-46e2-4cae-a5bf-bc717a4c800f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:59:26.516305 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf747-46e2-4cae-a5bf-bc717a4c800f service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:59:26.537387 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1444/2883] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:59:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jan 27 16:59:35.855830 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:59:35.857347 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:35.873699 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2d561-6368-47c2-a8b7-d7b6445bdf89 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:59:35.879777 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec343bcb-bf49-4b2b-8402-96659d146b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:59:35.880422 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343bcb-bf49-4b2b-8402-96659d146b85 service nova] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:59:35.880707 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343bcb-bf49-4b2b-8402-96659d146b85 service nova] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:59:35.880986 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec343bcb-bf49-4b2b-8402-96659d146b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:59:35.882755 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ec343bcb-bf49-4b2b-8402-96659d146b85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:35.895996 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec343bcb-bf49-4b2b-8402-96659d146b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:59:35.897567 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec343bcb-bf49-4b2b-8402-96659d146b85 service nova] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:59:35.908084 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1440/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:59:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 16:59:40.189941 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf747-46e2-4cae-a5bf-bc717a4c800f service nova] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 16:59:40.201258 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf747-46e2-4cae-a5bf-bc717a4c800f service nova] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 16:59:40.207614 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfc210-efd2-49d8-9592-babe9ab032da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8500a8d242bf43a9b2fd538c3b1bb037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 16:59:40.208265 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfc210-efd2-49d8-9592-babe9ab032da service nova] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 16:59:40.208548 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfc210-efd2-49d8-9592-babe9ab032da service nova] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 16:59:40.208827 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfc210-efd2-49d8-9592-babe9ab032da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 16:59:40.210594 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-42cfc210-efd2-49d8-9592-babe9ab032da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 16:59:40.223763 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfc210-efd2-49d8-9592-babe9ab032da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 16:59:40.225372 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cfc210-efd2-49d8-9592-babe9ab032da service nova] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 16:59:40.235886 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1445/2885] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 16:59:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 17:01:10.971926 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec343bcb-bf49-4b2b-8402-96659d146b85 service nova] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 17:01:10.981017 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec343bcb-bf49-4b2b-8402-96659d146b85 service nova] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 17:01:10.984531 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 17:01:10.985148 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 17:01:10.985430 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 17:01:10.985705 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 17:01:10.987546 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 17:01:10.998973 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 17:01:11.000447 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 17:01:11.009752 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1441/2886] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 17:01:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 17:01:23.932232 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfc210-efd2-49d8-9592-babe9ab032da service nova] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 17:01:23.941407 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfc210-efd2-49d8-9592-babe9ab032da service nova] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 17:01:23.945283 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cee0c-c861-4606-bfe7-95d73be03796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15ae418635734639a4d10676978e82cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 17:01:23.945919 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cee0c-c861-4606-bfe7-95d73be03796 service neutron] REQUEST_METHOD: `GET` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 17:01:23.946205 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cee0c-c861-4606-bfe7-95d73be03796 service neutron] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 17:01:23.946480 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cee0c-c861-4606-bfe7-95d73be03796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 17:01:23.948276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-ae5cee0c-c861-4606-bfe7-95d73be03796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 17:01:24.009485 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cee0c-c861-4606-bfe7-95d73be03796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 17:01:24.010898 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cee0c-c861-4606-bfe7-95d73be03796 service neutron] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 17:01:24.020801 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1446/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 17:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jan 27 17:01:30.298320 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 17:01:30.299761 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 17:01:30.375361 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085cb4-c25b-4bd3-a980-52e06861fc38 service neutron] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 17:01:30.380794 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 17:01:30.381653 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 17:01:30.381937 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 17:01:30.382216 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] PATH_INFO: `/v3/users/6bf586d36da74c29ab1a188bb6da8603` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 17:01:30.383417 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf586d36da74c29ab1a188bb6da8603)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 17:01:30.385365 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 17:01:30.428999 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf586d36da74c29ab1a188bb6da8603'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.435641 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf586d36da74c29ab1a188bb6da8603'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.436250 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf586d36da74c29ab1a188bb6da8603'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.448028 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf586d36da74c29ab1a188bb6da8603'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.455019 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf586d36da74c29ab1a188bb6da8603'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.460920 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1442/2888] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 17:01:30 2022] DELETE /identity/v3/users/6bf586d36da74c29ab1a188bb6da8603 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 17:01:30.626422 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cee0c-c861-4606-bfe7-95d73be03796 service neutron] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 17:01:30.685931 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cee0c-c861-4606-bfe7-95d73be03796 service neutron] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 17:01:30.739276 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 17:01:30.740162 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 17:01:30.740440 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 17:01:30.740711 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] PATH_INFO: `/v3/projects/4d8774be86e84ff7a66787d6f67c554e` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 17:01:30.741881 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8774be86e84ff7a66787d6f67c554e)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 17:01:30.743782 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 17:01:30.787752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8774be86e84ff7a66787d6f67c554e', 'request_id': 'req-2fca86ab-3917-4b35-ae35-82ed3c932c9d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.793489 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8774be86e84ff7a66787d6f67c554e', 'request_id': 'req-2fca86ab-3917-4b35-ae35-82ed3c932c9d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.798689 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8774be86e84ff7a66787d6f67c554e', 'request_id': 'req-2fca86ab-3917-4b35-ae35-82ed3c932c9d'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.810738 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] The token cache is being invalidate because project 4d8774be86e84ff7a66787d6f67c554e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 17:01:30.811034 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.811661 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.813146 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1447/2889] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 17:01:30 2022] DELETE /identity/v3/projects/4d8774be86e84ff7a66787d6f67c554e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 17:01:30.817967 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 17:01:30.819492 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 17:01:30.832664 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c139d0-2bd2-4989-8f30-723370b2f28b admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 17:01:30.885933 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 17:01:30.886727 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] REQUEST_METHOD: `DELETE` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 17:01:30.887014 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 17:01:30.887297 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] PATH_INFO: `/v3/users/189f725f8af144439a6f27d02914feae` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 17:01:30.888525 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] RBAC: Authorizing `identity:delete_user(user_id=189f725f8af144439a6f27d02914feae)` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 17:01:30.890450 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 17:01:30.934613 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189f725f8af144439a6f27d02914feae'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.940997 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189f725f8af144439a6f27d02914feae'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.941734 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189f725f8af144439a6f27d02914feae'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.952743 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189f725f8af144439a6f27d02914feae'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.959622 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.notifications [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189f725f8af144439a6f27d02914feae'} {{(pid=90785) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:30.965477 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1443/2890] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jan 27 17:01:30 2022] DELETE /identity/v3/users/189f725f8af144439a6f27d02914feae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 17:01:31.133285 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] Authenticating user token {{(pid=90784) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 17:01:31.134704 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.fernet_utils [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90784) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 17:01:31.151773 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca86ab-3917-4b35-ae35-82ed3c932c9d admin admin] Validating token access rules against request {{(pid=90784) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 17:01:31.207816 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b36880779e54979b4c28d8db11f3446', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e1134f718c7471d948ccfe1ca59674e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90784) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 17:01:31.208691 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 17:01:31.210018 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 17:01:31.210301 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] PATH_INFO: `/v3/projects/e228d95db50745c9ac65952bd8aad0ec` {{(pid=90784) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 17:01:31.211545 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e228d95db50745c9ac65952bd8aad0ec)` {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 17:01:31.213481 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] RBAC: Authorization granted {{(pid=90784) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 17:01:31.259517 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e228d95db50745c9ac65952bd8aad0ec', 'request_id': 'req-af394f91-1b64-4d27-8156-37297afb3c38'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:31.265654 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e228d95db50745c9ac65952bd8aad0ec', 'request_id': 'req-af394f91-1b64-4d27-8156-37297afb3c38'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:31.271072 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e228d95db50745c9ac65952bd8aad0ec', 'request_id': 'req-af394f91-1b64-4d27-8156-37297afb3c38'} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:31.283752 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] The token cache is being invalidate because project e228d95db50745c9ac65952bd8aad0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=90784) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jan 27 17:01:31.284135 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:31.285008 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: DEBUG keystone.notifications [None req-af394f91-1b64-4d27-8156-37297afb3c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=90784) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jan 27 17:01:31.287660 dv-cinder-818830-2-iscsi devstack@keystone.service[90784]: [pid: 90784|app: 0|req: 1448/2891] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jan 27 17:01:31 2022] DELETE /identity/v3/projects/e228d95db50745c9ac65952bd8aad0ec => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jan 27 17:01:59.081904 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] Authenticating user token {{(pid=90785) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jan 27 17:01:59.084082 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 17:01:59.184327 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816232d4-2593-410a-9cb9-a02c266b711a admin admin] Validating token access rules against request {{(pid=90785) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jan 27 17:01:59.241049 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18e95f-8ae8-40d5-ab1d-65d7429b8285 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f5bbcf690d144ab99438b3f65b5e100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84a0cf607357487a8b6b217245c7eeb9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=90785) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jan 27 17:01:59.241698 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e95f-8ae8-40d5-ab1d-65d7429b8285 service placement] REQUEST_METHOD: `GET` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jan 27 17:01:59.241985 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e95f-8ae8-40d5-ab1d-65d7429b8285 service placement] SCRIPT_NAME: `/identity` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jan 27 17:01:59.242269 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18e95f-8ae8-40d5-ab1d-65d7429b8285 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=90785) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jan 27 17:01:59.244062 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.fernet_utils [None req-8e18e95f-8ae8-40d5-ab1d-65d7429b8285 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=90785) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jan 27 17:01:59.254833 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18e95f-8ae8-40d5-ab1d-65d7429b8285 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jan 27 17:01:59.257366 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18e95f-8ae8-40d5-ab1d-65d7429b8285 service placement] RBAC: Authorization granted {{(pid=90785) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jan 27 17:01:59.266965 dv-cinder-818830-2-iscsi devstack@keystone.service[90785]: [pid: 90785|app: 0|req: 1444/2892] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jan 27 17:01:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)